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Abstract 


Can families in low-income contexts “pull themselves up by their bootstraps?” In rural Gam- 
bia, caregivers with high aspirations for their children, measured before the child starts school, 
invest substantially more in their children’s education. Despite this, essentially no children are 
literate or numerate three years later. In contrast, a bundled supply-side intervention adminis- 
tered in these same areas generated large literacy and numeracy gains. Crucially, conditional 
on receipt of this intervention, high-aspirations children are 25 percent more likely to attain 
literacy/numeracy than low-aspirations children. We also show how the test score SD metric 


can mislead when counterfactual learning levels are low. 


“Eble: Teachers College, Columbia University, eble@tc.columbia.edu. Escueta: Sanford School of Public Policy, 
Duke University, maya.escueta@duke.edu. We are grateful to the collaborators on the SCORE Trial - Chris Frost, Al- 
pha Camara, Baboucarr Bouy, Momodou Bah, Maitri Sivaraman, Pei-Tseng Jenny Hsieh, Chitra Jayanty, Tony Brady, 
Piotr Gawron, Stijn Vansteelandt, Peter Boone, and Diana Elbourne - as well as our research team in the Gambia, 
particularly Lamin Janneh; see Eble et al. (2021). This paper reports analysis of data collected in that study, which 
was approved by the Institutional Review Board of the London School of Hygiene and Tropical Medicine, protocol 
number 8767. We received helpful input from Naureen Karachiwalla, Kimi Chan, Beezer Cheble, Sarah Cohodes, Josh 
Merfeld, Kate Orkin, Phillip Ross, and seminar audiences at the Columbia Committee on the Economics of Education, 
the Columbia Population Research Center, the Gui2de/World Bank joint seminar, the New York Nanodev conference, 
and the RISE 2021 Annual Conference. This paper updates and replaces the previously circulated paper “Aspirations, 
Education, and Extreme Poverty.” Eble acknowledges support from the National Academy of Education (NAEd) and 
the NAEd/Spencer Postdoctoral Fellowship Program. Keywords: aspirations; education; poverty; complementarity. 


1 Introduction 


Many families wish to provide better lives for their children than experienced by previous genera- 
tions. One central lever families use to achieve this goal is education. Intergenerational educational 
mobility has been shown to correspond to economic mobility (Black et al., 2011; Chetty et al., 
2014, 2017), particularly in low and middle income countries (Azam and Bhatt, 2015; Asher et al., 
2018; Alesina et al., 2021). A series of theoretical and empirical studies has shown a strong linkage 
from one specific type of desire for the future, known as “aspirations,” to both greater investment in 
education and higher educational outcomes (cf. Beaman et al. 2012; Bernard et al. 2014; Genicot 
and Ray 2017; Lybbert and Wydick 2018; La Ferrara 2019).! It is not clear, however, whether this 
relationship — between desire for a better future for one’s children, investment in their education, 
and greater educational outcomes — also holds in contexts where complementary inputs are absent, 
or of low quality. 

In this paper, we study two core questions: first, if caregivers in low-income contexts want to 
raise their children’s learning levels, how much learning can they bring about on their own? Sec- 
ond, how does this relationship change if we relax the constraint of very low-quality educational 
supply? To do so, we follow children and their caregivers in rural Gambia over a period of three 
years, beginning from the time immediately prior to the child starting primary school. We measure 
aspirations at baseline, and estimate the mapping from baseline aspirations onto subsequent edu- 
cational investment and learning. We contrast these relationships with the impact of a supply-side 
intervention which dramatically raises learning levels, and show how the aspirations—learning re- 
lationship in this context varies with a large increase in the quality of educational supply. We also 
show how in cases with extremely low counterfactual levels of learning, the commonly-used test 
score standard deviation (SD) metric can yield a misleading conclusion about the importance of 


educational inputs in raising learning levels.” 


'See also the great summary of empirical work on this topic in Fruttero et al. (2021). 

°The SD metric has been used for measuring learning gains in several hundred studies in the economics of edu- 
cation and, in particular, reporting impact evaluations of educational interventions. For reference, see the numerous 
meta-analyses which collect and analyze these studies (Kremer and Holla, 2009; McEwan, 2014; Ganimian and Mur- 


We use data from a census of families in 169 villages in central parts of The Gambia. The 
data track families who, at the time of a baseline survey, intended to enroll at least one of their 
children in the first grade, for the first time, in the coming fall. This baseline survey collected 
families’ educational and career aspirations for these children. Families and children were then 
followed over three years, during which time data was collected on the child’s school enrollment, 
school-related time use, and on the family’s educational expenditure for the child. At endline, these 
children were administered one-on-one tests of basic reading and math skills. 

We focus on caregivers’ educational and career aspirations for the child, as in La Ferrara (2019). 
We operationalize this with two indicator variables, capturing the aspiration to have the child go 
to university, and the aspiration for the child to work in an urban area — a rough proxy for higher 
income jobs given that income in the city is so much higher than that in the countryside. At 
baseline, roughly sixty percent of families wish to send their children to university — roughly 
10 percentage points lower than found in recent studies of aspirations in Ethiopia and Somalia 
(Bernard et al., 2014; Kipchumba et al., 2021) and almost 40 percent lower than the proportion of 
caregivers in rural India who aspire to send their child to junior college (Attanasio et al., 2020). A 
similar proportion aspire that their child will work in an urban area. 

We find that higher baseline aspirations map onto greater subsequent investment in the child’s 
education. Late enrollment in school is a common problem in Sub-Saharan Africa (Glewwe and 
Jacoby, 1995; Bommier and Lambert, 2000), and enrollment of children in school at younger ages 
is a strong predictor of greater overall educational attainment (Nonoyama-Tarumi et al., 2010). 
Caregivers in our study population with greater educational and career aspirations for the child are 
between three and six percentage points more likely to enroll their child in school in the first two 
years of the study, as compared to children of caregivers with lower aspirations. In the final year of 
the study, when there are no enrollment differences, high aspirations caregivers spend significantly 


more money on the child’s education, and their children spend more time per day on school-related 


nane, 2016; Glewwe and Muralidharan, 2016; Evans and Yuan, 2020). 
These were Early Grade Reading and Math Assessments, also known as “EGRA” and “EGMA’ tests, respectively. 
See Platas et al. (2014) and Dubeck and Gove (2015) for details on their development, implementation, and limitations. 


tasks. 

Higher baseline aspirations also map onto higher endline test scores which appear, at first, to 
suggest substantially higher learning levels. Children whose caregivers report higher aspirations at 
baseline score 0.28-0.30 SDs better on a composite score of endline tests of basic reading and math 
ability, administered three years after the initial aspirations data were collected. The SD metric 
is a popular way to measure learning gains in studies of education, particularly in developing 
countries (Kremer and Holla, 2009; McEwan, 2014; Evans and Yuan, 2020). Put in the context 
of the hundreds of impact evaluations of educational interventions in developing country contexts 
covered by a series of recent meta-analyses‘, an estimate of 0.30 SD lies between the 75th and 90th 
percentile of effect sizes reported in these studies. One potential policy conclusion this implies is 
that higher aspirations are a key lever with which to increase learning levels in such low income 
contexts. 

By comparing our effect size estimates to estimates of skill-based learning gains, we show that 
the SD metric dramatically overstates the relationship between baseline aspirations and subsequent 
learning. Specifically, using standard definitions of literacy and numeracy, we estimate a precise 
zero relationship between baseline aspirations and endline learning. We also find very small gains 
in other, lower-level skill attainment. Because learning levels are compressed at the left tail of 
the distribution’, even a very small absolute gain in test scores in this context translates into a 
large change in SD units. In our case, the 0.30 SD gain we measure translates to the child being 
somewhat more likely to master one additional rudimental skill, such as differentiating which of 
two single-digit numbers is larger, or which of three words starts with a different sound. This gain 
leaves the modal child far from mastery of other basic skills necessary for literacy and numeracy 
— and expected of grade 2 students in The Gambia — such as reading simple words or calculating 
basic sums. We conclude from this that the standard deviation, used as a measure of effect size by 


itself without reference to the baseline level of learning, yields potentially misleading conclusions, 


4See those cited in the previous sentence and in Footnote 2. 

>As we describe later, we use tests that are particularly sensitive to measuring learning at the low end of the 
distribution. Nonetheless, because learning levels are so low in this area, most students demonstrate little evidence of 
mastery of any of the skills tested. 


particularly in contexts of low baseline learning levels.° 

We argue further that our estimates provide a likely upper bound on the relationship between 
aspirations and learning outcomes in this context, in the absence of external intervention. This 
is because potential unobservable confounders — for example, unobserved wealth, education, or 
tastes — are most likely to be positively correlated with both the aspirations we study and educa- 
tional outcomes (Bernard et al., 2014; Ross, 2019). Should such unobserved traits influence our 
estimates, the true relationship is likely even smaller than what we measure.’ 

Next, we show that higher aspirations do map onto a much greater likelihood of achieving 
literacy and numeracy when high-quality complementary inputs on the supply side are present. As 
reported in Eble et al. (2021), a highly-resourced, bundled supply-side educational intervention 
randomly assigned to be offered in some of these same villages yielded transformative learning 
gains. We find that this large increase in the quality of educational supply dramatically changes 
the relationship between baseline aspirations and endline learning: conditional on their village 
being randomly assigned to receive the intervention, children whose caregivers have high baseline 
educational aspirations for the child are 25 percent more likely to reach literacy and numeracy at 
endline than children whose caregivers do not. This finding echoes the results of a large RCT in 
Tanzania which uncovered evidence of complementarities between inputs on the supply side in the 
production of education (Mbiti et al., 2019). 

Finally, we also find that the intervention affects educational aspirations at endline. We estimate 
that being randomized to a village which receives the intervention raised the endline proportion of 
caregivers who aspire to have their child attend university by about seven percentage points, from 
a baseline of roughly sixty percent. We see no evidence of an effect for career aspirations. 

Our paper makes two key contributions. First, we advance understanding of how the demand- 


side and supply-side interact to generate learning in low income contexts (cf. Jensen 2010; Glewwe 


©This inverse relationship between the learning contained in a given effect size estimate and the baseline learning 
level of the population being studied has also been found in US schools (Hill et al., 2008). 

7While our sample includes only children whose parents intend to enroll them in school the year after our baseline 
survey, meaning there is selection from the census of children in these villages to our study population, we argue that 
our estimates show the maximum learning gains a child in this setting is likely to expect were their caregiver to have 
higher aspirations for the child. See the discussion in Section 4.3 for more details. 


and Muralidharan 2016; La Ferrara 2019; Muralidharan et al. 2019; Romero et al. 2020). We show 
that even in the face of severe income poverty, many families want to provide a better life for their 
children and act upon this desire by investing more in their children’s education. We then demon- 
strate that these desires can map onto large gains in learning, but only when complementary inputs 
on the supply side are present. This adds to other recent evidence on the presence of complemen- 
tarities in the provision of education in low-income settings (Mbiti et al., 2019). Second, we show 
that in settings characterized by very low baseline learning levels, the test score standard deviation 
—a metric for measuring learning used in hundreds of previous studies (McEwan, 2014; Ganimian 
and Murnane, 2016; Evans and Yuan, 2020) — can yield an erroneously positive conclusion about 
the relative importance of educational inputs. In light of this, we argue that skill-based learning 
measures should be preferred when assessing the efficacy of interventions and the relative impor- 
tance of various educational inputs in contexts with very low baseline levels of learning (Platas et 
al., 2014; Dubeck and Gove, 2015; Filmer et al., 2020). We also contribute to the growing body of 
work on the role of aspirations in education and development (cf. Dalton et al. 2016; Genicot and 
Ray 2017; Lybbert and Wydick 2018; Serneels and Dercon 2021) 

The rest of the paper proceeds as follows. Section 2 describes the setting in which we work 
and the data we collected. Section 3 describes our research design. Sections 4 and 5 present our 


main empirical results and Section 6 concludes. 


2 Background, setting, and data 


In this section, we describe the setting in which we work, the data we analyze, and the measures 


of aspirations we use. 


2.1 Setting 


Our study takes place in small, rural settlements in the North Bank and Lower River regions of The 


Gambia. The Gambia is located in West Africa, with Senegal on its border to the north, east, and 


south, and the Atlantic Ocean to its west.® It is a former British colony and served as a major hub 
for the trans-Atlantic slave trade. Its population is roughly two million people, and its geographic 
area covers roughly 11,300 square kilometers (CIA, 2019). It is also very income poor: per-capita 
GDP was estimated to be $716 in 2018. The country’s main sources of economic activity are 
agriculture, tourism, remittances, and foreign aid. 

In addition to income poverty, the country’s education levels are also very low. In 2013, the 
Demographic and Health Surveys estimated that only 26.7 percent of adults living in rural areas 
were literate, and roughly half of adults in these areas had never been to school (The Gambia 
Bureau of Statistics and ICF International, 2014). Other national assessments of children’s reading 
and math abilities have shown that even among children, learning levels are dramatically lower 
than in other countries in the region (Sprenger-Charolles, 2008). 

Our study focuses on the population of children and families enrolled in the randomized con- 
trolled trial reported in Eble et al. (2021). The research took place in 169 villages in the two 
central regions of The Gambia, beginning with the universe of villages in these two regions who 
had between 10 and 300 households according to the 2013 national census.’ Ultimately, the study 
enrolled 169 of these villages which met the predetermined eligibility criterion of having at least 
10 eligible children.!° Children were eligible if, at the time of enumeration in early 2015, i) they 
were between the ages of 6 and 8, 11) they had not yet entered the first grade, and iii) their primary 
caregiver intended to enroll them in the first grade in the coming academic year. Because presence 
in this sample is conditional on the caregiver intending to enroll the child in school in the coming 
year, this means that aspirations measured among participants may differ from the population in 
these areas. When abstracting from our sample to the population of children in this age range in 
our study areas, we make the following assumption: the trajectory of literacy and numeracy skills 


among excluded children is unlikely to be dramatically better than of study participants (though 


8In Figure A.1, Panel A, we show a map of The Gambia’s location on the African continent. 

°In Figure A.1, Panel B, we show a map of The Gambia indicating the regions in which these villages are located. 

‘OThere were 323 total villages to begin with. Of these, 113 had too few children to be eligible. The study excluded a 
further 41 of the remaining villages to create buffer zones between villages in order to ensure no potential for spillover 
between villages, i.e., caregivers of children in control villages instructing their children to walk into an intervention 
village and avail themselves of the intervention there. 


it could be either similar, or worse). This stems from the fact that excluded children will enter 
school later than study children, and later school entry corresponds to worse academic outcomes 
in similar settings (Glewwe and Jacoby, 1995; Bommier and Lambert, 2000). 

There were 4,518 children enumerated at baseline, 3,825 for whom we have endline test scores. 
For the sake of brevity, we focus on these 3,825 students in our analysis. !! In the next section, we 


describe the characteristics of these children and their families. 


2.2 Data 


The data began with a census of children in study villages meeting the eligibility criteria described 
above. Data were collected from these children and their caregivers over the period from January 
2015 to May 2018. Participants were enumerated in early 2015 and randomization occurred in late 
2015. Villages randomly assigned to the intervention arm received a highly-resourced, bundled 
intervention providing after-school remedial education delivered by para teachers. This program 
began in early 2016 and continued until the beginning of May 2018. In these villages, para teachers 
from within the village or nearby were hired and trained to use scripted lessons to deliver after- 
school, supplementary education for 12 hours per week over the course of the study, following 
the official Gambian curriculum as children progressed through school. These para teachers were 
regularly monitored with a focus on “coaching,” that is, improving their instructional capacity and 
ensuring student learning. 

In mid-to-late May and June of 2018, early grade reading and math assessments - EGRA and 
EGMA tests, respectively (Platas et al., 2014; Dubeck and Gove, 2015) — were administered to 
all study children. Each test is comprised of different “subtasks” (i.e., skills); in Table A.1 we 
describe the subtasks/skills evaluated by each test. There are six subtasks within each test; as the 
number of the subtask rises (from | to 5, for example), the difficulty/complexity of the skill being 
tested increases. We provide the full test papers in Appendix A. We refer to these as the endline 


tests, and calculate the average of these two scores to generate one composite endline test score. 


Baseline aspirations do not predict attrition at the endline test. 
This intervention is described in greater depth in Eble et al. (2021). 


We also use standard, binary measures of literacy and numeracy based on performance on certain 
subtasks.!? Our other main outcome data focus on educational investment. These consist of data 
on child enrollment in school, collected at the end of each academic year, along with the child’s 
school-related time use on an average weekday, and caregiver expenditure on the child’s education, 
both measured in the third (and final) year of the study. 

In Table 1, we present a few key demographic characteristics of the children in our sample 
overall and, separately, by the arm of the trial into which they were randomized. From here onward, 
we refer to children in villages randomized to receive the intervention as the “intervention” group 
and those in villages randomized to not receive the intervention as the “status quo” group. At 
baseline, more than three quarters of all children were being cared for by adults — whom we call 
caregivers — who had never been to school.'* This is lower than overall data for The Gambia (The 
Gambia Bureau of Statistics and ICF International, 2014), consistent with the fact that the areas in 
which the study took place are lower-income, more remote, and less well-served by the government 
than many others in the country. We observe a simple proxy for wealth: whether the floor, walls, 
and roof of the home are made of synthetic materials, also used in Eble et al. (2021), with roughly 


one quarter of households living in homes constructed entirely out of synthetic materials. 


2.3. Measuring aspirations 


Next we describe the measures of aspirations we use, their properties, and their correlation with 
other factors that contribute to the educational investment and learning outcomes we study. 

We observe caregiver aspirations for the child at two points in time: at the beginning of the 
study, in the months before the child would enter school for the first time, and again at the end of 


the study, after three years had passed. We will refer to these as “baseline” and “endline” levels of 


'34 child is assumed to be literate if they can read “with good fluency” (45 words per minute) and correctly answer 
at least 80% of reading comprehension questions. A child is assumed to be numerate if they can successfully identify 
missing numbers in a sequence (e.g., 2, 4, _, 8) in at least 70% of the questions on the test, and correctly answer at 
least 80% of word problems. These definitions are the same used in Fazzio et al. (2021). 

'4We focus on caregivers, as opposed to parents, because early fieldwork suggested that the most important person 
for the child’s development is the primary person from whom the child receives their day-to-day care. This is often, 
but not always, the parent. In our data, roughly 75% of caregivers are mothers, 11% are grandmothers, and the rest are 
various other members of the household in which the child lives. 


Table 1: Demographic characteristics 


() (2) (3) 

All — Status quo Intervention 
Child is female 0.50 0.51 0.48 
Has five or more siblings 0.41 0.43 0.39 
Caregiver is functionally illiterate 0.92 0.92 0.92 
Caregiver is not child’s mother 0.23 0.22 0.23 
Books found in house 0.67 0.65 0.69 


Caregiver education 


Never been to formal schooling 0.76 0.77 0.76 
At least some primary education 0.16 0.15 0.16 
At least some junior secondary education 0.06 0.06 0.06 
At least some senior education, or more 0.02 0.02 0.02 
Household wealth 

House is made of all natural materials 0.06 0.05 0.08 
House is made of partially synthetic materials 0.68 0.68 0.68 
House is made of all synthetic materials 0.26 0.28 0.24 
Observations 3,825 2,045 1,780 
Joint F-statistic 0.572 

(p-value) (p= 0.684) 


Table 1 note: this table presents select demographic characteristics for children in our sample, 
both overall (column 1) and then separately by the treatment status to which they were randomized 
(columns 2 and 3, respectively). The joint F-statistic is a test of the null that these variables together 
are not jointly predictive of the child’s randomization status to the intervention (treatment) or status 
quo (control) group, clustering by trial-assigned clusters of contiguous villages. All variables in 
this table, except for the number of observations, are binary, with 0 = No and | = Yes. 


aspirations, respectively. As in La Ferrara (2019), we focus on two types of aspiration. The first is 
the caregiver’s aspirations for their child’s highest level of educational attainment. The second is 
the caregiver’s aspirations for their child’s career in adulthood. To capture educational aspirations, 
at the beginning of the trial, we asked the child’s main caregiver: “ideally, what is the highest 
level of education you would like [child name] to attain?” To capture career aspirations, we asked 
the caregiver: “when [child name] is 20 years old, what job do you hope [she/he] will be doing?” 
These questions were again asked at the end of the study period, with the age specified in the career 
question changed to 25 to reflect the advancement of time and to stick with a “round” number. 

These questions were designed to capture broader, latent variables about the caregiver’s aspi- 
rations for the child’s education and career, respectively. They were piloted prior to use, and are 
similar to those asked in other studies of aspirations in Ethiopia, India, and Somalia (Bernard et 
al., 2014; Attanasio et al., 2020; Kipchumba et al., 2021). Lybbert and Wydick’s 2018 study of 
aspirations differentiates between “aspirational hope” and “wishful hope”, arguing that the latter 
are characterized by a lack of a viable pathway to achieve them. In our study area in the Gambia, 
as in the Ethiopian, Indian, and Somalian contexts referenced above, few individuals are likely to 
go to college or university. Nonetheless, we follow these papers by referring to responses to the 
two questions as capturing aspirations; as we show, they are important predictors of the subsequent 
future-oriented investment behavior we study.!> 

In Table 2, we summarize caregivers’ responses to these questions. In Panel A we show this 
for all children, and then for intervention children and status quo children, respectively, calculating 
the difference between the two groups. In Panel B, we conduct a similar analysis for girls and 
for boys. In Column 1, we first show the proportion of all children whose caregiver expresses 
the relevant aspiration for the child at baseline. We see that, at baseline, roughly 60 percent of 
caregivers report aspirations for the child to go to university. This is slightly lower than levels 


recently recorded in rural Ethiopia (Bernard et al., 2014) and Somalia (Kipchumba et al., 2021). 


'SThe aspirations we measure also differ importantly from expectations. In our pilot, we worked to choose language 
that differentiated between aspirations and expectations. In this work, however, we determined that we could not ask 
respondents about both expectations and aspirations without unacceptably large priming effects. 
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The question regarding caregiver aspirations for their child’s career allowed the respondent to 
answer freely; responses that did not clearly fall into one of 14 listed categories were recorded as 
given and later coded. Given economic conditions in The Gambia and our initial analysis of this 
response data, we considered the following two broad categories of employment: working for the 
government and working in an urban area. Since more than 85 percent of respondents chose some 
type of work for the government, leaving little variation to study, we instead focus on aspirations 
to work in an urban area.'© This captures most jobs which require literacy and numeracy skills. 
As mentioned earlier, this construction also incorporates the fact that income in the city is much 
higher than in the countryside. Roughly 65 percent of caregivers express this aspiration for their 
child’s career. The correlation between aspirations for the child to attend university and for the 
child to work in an urban area is 0.187, indicating substantial independent variation between the 
two. 

Comparing across groups, we see no difference in baseline aspirations between intervention 
and status quo children. We also find small — no more than three percentage point — differences 
between caregivers’ aspirations for girl and boy children for our main two aspirations variables. 
These differences are not statistically significant at conventional levels. Next, we describe how 
baseline aspirations correlate with other baseline characteristics that might predict educational 
investment and learning levels. In Table 3, we present conditional means of aspirations levels by a 
series of variables related to relative economic prosperity, household configuration, and caregiver 
education. We capture caregiver education with two variables: one is a binary variable that captures 
whether the child’s caregiver has received any formal schooling; the other captures whether the 
caregiver is functionally illiterate at the time of a baseline survey. We capture household wealth 
with a binary variable capturing whether the home is made of synthetic materials, as used in Eble 
et al. (2021). We also include an indicator variable equal to one if the child has five or more 
siblings. This is meant to proxy for the number of children across which educational investments 


must be divided. Finally, we show baseline levels of aspirations by whether there were any books 


!6This includes jobs such as doctor, nurse, judge, legal clerk, or politician, but not jobs like Imam, farmer, or farm 
laborer. 
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Table 2: Aspirations at baseline 


(1) (2) (3) (4) 

Panel A: Control vs. treatment All Status quo Intervention P-value 
Highest level of education: university 0.61 0.61 0.61 0.89 
Broad work categories 

Job in urban area 0.65 0.65 0.65 0.93 
Government job 0.87 0.86 0.87 0.70 
Top jobs aspired to 

Teacher 0.26 0.26 0.27 0.89 
Work for government (no further detail) 0.22 0.23 0.21 0.55 
Nurse 0.15 0.15 0.15 0.94 
Observations 3,825 2,045 1,780 —_— 

(1) (2) (3) (4) 

Panel B: Female vs. Male All Female Male P-value 
Highest level of education: university 0.61 0.60 0.63 0.06 
Broad work categories 

Job in urban area 0.65 0.67 0.64 0.06 
Government job 0.87 0.89 0.84 0.00 
Top jobs aspired to 

Teacher 0.26 0.26 0.27 0.31 
Work for government (no further detail) 0.22 0.20 0.24 0.00 
Nurse 0.15 0.24 0.07 0.00 
Observations 3,825 1,895 1,930 — 


Table 2 note: this table presents baseline aspirations data for children in the trial, both overall 
(column 1) and, in columns 2 and 3, separately by the group as described in the panel title and 
column heading. Column 4 presents the p-value of a t-test for the null that the aspirations levels 
are equal at baseline for the groups mentioned in the panel title, derived from a regression of 
the variable on the panel group variable. We clustered standard errors by trial-assigned clusters 
of contiguous villages. These results are robust to adding controls for caregiver education and 
household wealth. 
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found in the child’s home during the baseline survey, and whether the child’s main caregiver is 
their biological mother. These characteristics are all predetermined relative to our measurement of 
aspirations. 

The child’s caregiver is roughly ten percentage points more likely to express either of these 
aspirations for the child if the caregiver has previously been to school. We also see a large differ- 
ence in baseline educational aspirations by whether the caregiver is literate or not (recall that only 
8 percent of caregivers are literate), and a smaller difference by the presence of books in the house. 
There is some evidence of a difference in baseline career aspirations by household wealth, but not 
in educational aspirations. We see no differences in baseline aspirations by the number of siblings 
or the identity of the caregiver. 

The pairwise correlations between aspirations and caregiver education are small (0.114 for 
the aspiration to have the child attend university, and 0.104 for them to work in an urban area). 
There is no evidence of correlation between our rough proxy of wealth and either aspirations 
measure, nor is there correlation between wealth and caregiver education. This is in line with the 
notion that, in rural parts of The Gambia, higher levels of wealth are not necessarily predictive of 
greater education, particularly given the importance of farming and animal husbandry. In our later 
analysis of the relative importance of baseline aspirations on subsequent educational investment 
and learning gains, we add controls for these variables, isolating the relationship between the 


portion of aspirations orthogonal to these variables and our dependent variables. 


3 Research design 


In this section we describe the analyses we use to answer our core research questions. Our first 
research question is how aspirations at baseline map onto later investment in education and endline 
learning levels for families in rural parts of The Gambia. To answer this research question, we 


estimate the following equation: 


Vite = OH + Aj As=0,ic + O2X1=0,ie + Nr + Eic (1) 
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Table 3: Correlates of aspirations 


() (2) 
Aspires that —_Aspires that child 
child will go to will find work in 


university urban area 

Child gender 

Male 0.63 0.63 
Female 0.60 0.68 
P-value of difference (0.08) (0.04) 
Caregiver education 

Caregiver has been to school 0.71 0.75 
Caregiver has never been to school 0.58 0.63 
P-value of difference (0.00) (0.00) 
Caregiver literacy 

Can read simple sentence 0.83 0.83 
Cannot read simple sentence 0.60 0.64 
P-value of difference (0.00) (0.00) 
Materials of home 

Home made of synthetic materials 0.62 0.68 
Home made of natural materials 0.61 0.65 
P-value of difference (0.78) (0.13) 
Number of siblings 

Less than five 0.62 0.65 
Five or more 0.63 0.67 
P-value of difference (0.61) (0.42) 
Books in house 

Books in house 0.64 0.66 
No books found in house 0.57 0.65 
P-value of difference (0.00) (0.81) 


Table 3 notes: This table shows the conditional means of aspirations across the baseline char- 
acteristics labeled in the left-most column. We break these baseline characteristics into binary 
variables, showing the conditional mean of the aspiration for both values of the characteristic, and 
the p-value for a t-test of the null that the aspiration in question is equal for those with each value 
of the baseline characteristic. 


14 


This regresses the outcome variable of child 7 in cluster c at time f on Qo, a constant; A;—o,;c, the 
aspirations of the caregiver for child i at baseline (i.e., when t = 0); X;=0,ic, a vector of predeter- 
mined variables for child i, measured at baseline (these include all the variables shown in Table 3); 
and 17,, a region fixed effect. We cluster our standard errors at the level of contiguous clusters of 
villages, &-.!’ Our main coefficient of interest is @, which captures the mapping from baseline 
aspirations to subsequent outcomes, after controlling for the baseline characteristics listed in Table 
3, such as gender, wealth, and caregiver education. 

In these analyses, we use only data from the status quo group. This is because, as shown in 
Eble et al. (2021), the intervention group’s subsequent educational investment and endline learning 
levels are affected by receipt of the intervention, confounding our ability to measure the status quo 
mapping from baseline aspirations to subsequent outcomes among children in this context. 

Our second research question asks whether the relationship from baseline aspirations to subse- 
quent learning levels, estimated in question 1, changes with a dramatic improvement in the quality 
of educational supply. In these analyses we study children in both the status quo and intervention 
groups. Here we also use ordinary least squares, regressing the outcome variable on a constant, the 


treatment variable (which was randomly assigned), baseline aspirations, and their interaction: 


Vice = Bo + Bi T+ BoAr=0,ic =r B3T. * At=0,ic + B4X1=0 ,ic + Nr + Eic (2) 


Here T;, is child i’s treatment status, and A;—o ;- is again the relevant measure of aspirations for the 
child reported by their caregiver at baseline. Here too we cluster our standard errors by cluster 
of contiguous villages. Our main coefficient of interest is B3; the sign and significance of this 
coefficient indicates whether this change in the quality of educational supply changes the mapping 
from baseline aspirations to endline learning. Because the intervention is randomized and baseline 
aspirations are pre-determined, we do not include additional controls. 

Finally, we study whether receipt of the intervention has an effect on the formation of aspi- 


rations. To do so, we estimate a version of Equation 2, using endline aspirations as the outcome 


'7This is the same level as the randomization in Eble et al. (2021). 
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variable. In this estimation, we drop the term [37. * Aoj- from the right hand side of the equation 
because it is not relevant to answering this specific research question and, as shown in Table 2, 
baseline aspirations are orthogonal to randomization group (our results are robust to including it 
in the specification). In this case, our main coefficient of interest is By. Because our paper reports 
exploratory analysis of existing data, we did not register a pre-analysis plan (Olken, 2015; Lin 
and Green, 2016), though the analysis for the broader RCT was pre-specified and pre-registered 
(Boone et al., 2015). 


4 Aspirations, educational investment, and learning 


In this section, we present our empirical results on how baseline aspirations map onto subsequent 
educational investments and endline learning levels in the status quo group. The “investments” 
we consider are time and money. Time is measured by enrollment in school each year, as well as 
the proportion of time that the child spends on school-related tasks on a typical weekday in the 
final year of the study. The measure of monetary investment we use is the caregiver’s educational 
expenditure on the child’s education, also captured in the third and final year of the study. We study 
the mapping from baseline aspirations to endline learning levels first using the child’s performance 
on the endline test. We then contrast this with estimates generated using standard measures of 
literacy and numeracy based on performance on these tests, as well as measures of the child’s 
mastery of various specific reading and math skills. Finally, we discuss how potential influence 


from unobserved factors is likely to bound our effects. 


4.1 Aspirations and educational investment 


We first characterize the mapping from baseline aspirations levels to subsequent educational invest- 
ment. We present our estimates in Table 4; the outcome variables, named in the column headings, 
are educational expenditure in year three of the study, child time use in year three of the study, and 
enrollment in school in each of the three study years. 


We find a positive and statistically significant mapping from both types of baseline aspirations 
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to subsequent educational investments. For educational expenditure, we see that children whose 
caregivers hold higher educational or career aspirations for the child spend between 10 and 15 
percent more per year on costs related to the child’s education.!® For enrollment in school, we see 
evidence that children whose caregivers have higher educational or career aspirations for the child 
at baseline are more likely to be enrolled in school in the first two years of the study. This pattern 
disappears in year three of the study, at which point almost all children are enrolled in school. 
Nonetheless, this early difference is important: delayed enrollment in school is a strong predictor 
of lower overall educational attainment (Nonoyama-Tarumi et al., 2010). In addition, in that third 
and final year when essentially all children are enrolled in school, we find a statistically significant 
difference in the proportion of time on a typical weekday that the child spends on school-related 
tasks, with more time spent by children whose caregiver expressed high educational aspirations 
at baseline, though not for those expressing high career aspirations. The mapping from these 
aspirations to educational expenditure and enrollment are of the same order of magnitude as the 
estimated effect of the intervention-driven aspirations gain on educational investment measured in 
Bernard et al. (2014). 

To better understand what other baseline characteristics predict early educational investment, 
we also present coefficients for other control variables. These show a few key patterns. First, the 
mappings from other factors to educational investment have a similar order of magnitude as do 
those for baseline aspirations. Second, the signs of these estimated relationships are as expected; 
for example, there is a statistically significant positive relationship between wealth and educational 


expenditure. 


4.2 Aspirations and learning outcomes 


We next characterize the relationship between baseline aspirations and endline learning levels, as 
measured by performance on the endline test, both in terms of the raw composite endline test 


score and standard measures of literacy and numeracy based on performance on given subtasks, as 


'8Expenditures are shown in 2020 US dollars; this difference is between 75 and 90 Gambian Dalasis, converted at 
arate of 51.71 dalasis per dollar. 
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Table 4: Estimating the mapping from baseline aspirations to subsequent educational investment 
in the status quo group 


(1) (2) (3) (4) (5) 
Educational School-related — Enrolled in Enrolled in Enrolled in 
expenditure time use school, year 1 school, year 2 school, year 3 


Panel A: Educational aspirations 


Aspiration: child will go to college 79.04%* 0.019** 0.032 0.052** 0.005 
(27.23) (0.007) (0.028) (0.025) (0.008) 
Wealth index high 109.04** 0.003 -0.009 -0.029 -0.002 
(40.22) (0.008) (0.025) (0.018) (0.012) 
Caregiver cannot read -79.51 -0.028** -0.066* -0.061** -0.017* 
(70.06) (0.012) (0.036) (0.026) (0.008) 
Books found in house 72.49%* 0.011* 0.047** 0.045*** 0.007 
(28.23) (0.007) (0.020) (0.014) (0.006) 
Child is female -14.32 0.005 0.020 0.005 0.009 
(21.49) (0.008) (0.015) (0.023) (0.008) 
Comparison group mean 611.36 0.545 0.825 0.802 0.971 
Number of observations 1,862 1,908 1,937 1,909 1,908 


Panel B: Career aspirations 


Aspiration: child will work in urban area = 74.14** 0.005 0.036 0.055*** 0.001 
(26.88) (0.006) (0.025) (0.020) (0.005) 
Wealth index high 106.89** 0.003 -0.010 -0.030 -0.002 
(39.59) (0.008) (0.025) (0.018) (0.012) 
Caregiver cannot read -81.99 -0.030** -0.067* -0.062** -0.017** 
(68.16) (0.012) (0.036) (0.027) (0.009) 
Books found in house 77.20** 0.012* 0.049** 0.048*** 0.007 
(28.00) (0.007) (0.019) (0.014) (0.006) 
Child is female -20.85 0.004 0.018 0.001 0.009 
(21.58) (0.008) (0.015) (0.024) (0.008) 
Comparison group mean 617.54 0.553 0.820 0.799 0.973 
Number of observations 1,862 1,908 1,937 1,909 1,908 


Table 4 notes: this table shows the results of estimating Equation | on the outcome variables listed 
in the column heading using baseline aspirations as indicated in the panel heading. Dependent 
variables are defined in the text. These analyses include only children in the status quo group. 
We report clustered standard errors in parentheses below each estimated coefficient. Observations 
vary by column because outcome variables were collected at different times and some children 
were missed in some periods. Results are robust to including only the smallest estimation sample. 
The full set of controls is as indicated in Section 3. *p < 0.10, **p < 0.05, ***p < 0.01. 


18 


described in Section 2.2. We present these results in Table 5. We first show this for raw test scores. 
In column | we show our estimates which find that, after controlling for baseline characteristics, 
children whose caregivers have higher baseline aspirations for the child perform between 3.3 points 
for educational aspirations, and 3.8 points for career aspirations, better, from a low aspirations 
group mean of 15 points (that is, answering 15 percent of questions on the endline test correctly). 
These differences are both highly statistically significant. 

We plot the distribution of these scores, by aspiration group, in Figure 1. This shows that 
the high aspirations group’s test score distribution first-order stochastically dominates the that of 
the low aspirations group for both types of aspiration. Kolmogorov-Smirnov tests confirm this 
observation (p<0.001 in both cases). Using the common practice of scaling this raw difference 
by the standard deviation (SD) of the variable among the comparison group, this comprises a 
difference of 0.28-0.30.!9 These differences appear large in SD terms; they lie between the 75th 
and 90th percentile of effect estimates reported in the hundred of studies summarized in a series 
of recent meta-analyses of evaluations of educational interventions in such contexts, including 
Kremer and Holla (2009), McEwan (2014), Glewwe and Muralidharan (2016), and Evans and 
Yuan (2020). 

Next, we show that when measured in terms of skills gained, these gains appear much smaller 
and, for our measures of literacy and numeracy, disappear entirely. We take two approaches to 
measure skill acquisition. The first is to generate similar effect estimates, only using use binary 
measures of literacy and numeracy based on performance in the EGRA and EGMA tests described 
in Section 2.2. In columns 2 and 3, we report our estimates of Equation | using these two mea- 
sures, respectively, as our outcome variables. We estimate precise zeros, finding no evidence of a 
relationship between baseline aspirations and endline likelihood of achieving literacy or numeracy. 
The confidence intervals we generate can reject anything larger than a one percentage point change 
in the likelihood of having attained either skill at endline as a result of having a caregiver with high 


educational or career aspirations at baseline. 


!°Estimated using Cohen’s d. 
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Table 5: Estimating the mapping from baseline aspirations to endline learning in the status quo 
group 


(1) (2) (3) 
Endline Childis Child is 
test score literate numerate 
Panel A: Educational aspirations 


Aspiration: child will go to college 3.278*** — -0.001 -0.001 
(0.910) (0.002) (0.004) 


Wealth index high 1.863* 0.001 -0.001 
(1.019) (0.002) (0.004) 


Caregiver cannot read -5.985*** 0.001 0.002 
(1.482) (0.001) —_ (0.002) 


Books found in house 2.960*** 0.001 0.001 
(0.725) (0.001) (0.003) 


Child is female 1.877** — -0.002 0.001 
(0.843) (0.001) (0.003) 


Comparison group mean 14.964 0.001 0.006 
Number of observations 1,971 1,971 1,970 


Panel B: Career aspirations 


Aspiration: child will work in urban area 3.792*** — 0.002 0.003 
(0.658) (0.001) (0.004) 


Wealth index high 1.771* 0.001 -0.001 
(1.034) (0.002) —_ (0.004) 


Caregiver cannot read -6.023*** 0.001 0.002 
(1.468) (0.001) ~—_ (0.002) 


Books found in house 3.179*** 0.001 0.001 
(0.711) (0.001) (0.003) 


Child is female 1.583* -0.002 0.001 
(0.878) (0.001) — (0.003) 


Comparison group mean 14.604 0.000 0.004 
Number of observations 1,971 1,971 1,970 


Table 5 notes: in this table we show results from estimating Equation 1 on the outcome variables 
listed in the column heading, for the baseline aspirations indicated in the panel title. These analyses 
include only children in the status quo group. The scale of the endline test score is 0-100. Literacy 
and numeracy are indicator variables. We report clustered standard errors in parentheses below 
each estimated coefficient. The full set of controls is as indicated in Section 3. *p < 0.10, **p < 
0.05, ***p < 0.01. 
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Figure 1: Distribution of endline test scores for the status quo group, by aspirations 
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Figure | notes: this figure shows kernel density plots of endline test scores for children whose 
caregivers did (red dashed line) and did not (solid blue line) express the aspiration listed in the 
panel title. In these plots, we focus on children in the status quo group (that is, in villages assigned 
to not receive the intervention) and for whom we have a test score, comprising 1,971 observations. 
The vertical lines show the mean test score of the group whose distribution is plotted using the 
same width, color, and pattern of line. Kolmogorov-Smirmov tests reject the equality of the two 


distributions with p < 0.001. 
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The second way we measure the mapping of aspirations to subsequent skill acquisition uses 
test score gains in terms of the various skills each test evaluates.7° In Figure 2, we plot the mean 
percent of correctly answered questions for skill by baseline aspirations levels. This illustrates 
how low endline skill levels are in the status quo group overall, regardless of baseline aspirations 
levels. It also highlights the very small absolute difference in skills between low aspirations and 
high aspirations children. In Tables A.2 and A.3, we show the regression equivalent of these 
comparisons, estimating Equation | using the subtask score as the dependent variable. 

Our estimates of the high aspirations-low aspirations difference in endline test scores suggest 
that children whose caregivers hold high career or educational aspirations for the child would be 
more likely to master one more basic math or reading skill than children whose caregivers do not. 
In math, for example, this would mean these children would be able to differentiate which of two 
numbers was larger. In reading, it would mean that these children would be able to differentiate 
which of three words started with a different sound. 

Unfortunately, all children in the status quo group display extremely low skill levels at endline. 
Figure 2 shows that, regardless of baseline aspirations, these children can correctly answer fewer 
than 10 percent of questions for most higher-level math and reading skills, such as single-digit 
subtraction or the ability to read simple, familiar words such as “and” and “but.” As a result, even 
the large relative difference in test score standard deviations between children with low and high 
caregiver aspirations at baseline translates into a small absolute difference in endline reading and 
math skills. 

This is best illustrated in the distribution of test scores, where we can see that essentially no 
children in the status quo group are even close to achieving either literacy or numeracy at endline. 
A helpful reference is that literacy and numeracy begin to manifest when a child correctly answers 
roughly 60 to 65 percent of questions on these tests. Examining the distributions in Figure 1, in 
both the high aspirations and low aspirations distribution of composite endline test scores, very 


few children score near these levels, with vanishingly few at or above them. 


0See Table A.1 for a description of these skills and Appendix A for the full test papers. 
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Figure 2: Endline skill levels in the status quo group, by baseline aspirations 
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Panel B: Career aspirations 


Figure 2 notes: This figure shows endline performance in the status quo group on each of the 
individual subtasks of the EGRA and EGMA tests, by baseline aspirations level. The relevant 


aspiration is indicated in the panel label. The number of observations per group are the same as in 
Table 5. 
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As a result, higher aspirations by themselves — even with the greater levels of investment that 
correspond to them — are unlikely to lead to a greater likelihood of literacy or numeracy for most 
children in rural Gambia. Furthermore, because in such contexts the school curriculum normally 
advances to higher level skills as children progress in grade level, even if these children do not mas- 
ter the necessary lower-level skills (Pritchett, 2013; Muralidharan et al., 2019), the vast majority 
of these children are unlikely to ever achieve basic literacy or numeracy. 

This finding builds on other work on how higher aspirations may not always lead to educational 
gains. Dalton et al. (2016) use a model to show that there can be suboptimally high aspirations, 
and that if there exists an insurmountably large gap between the aspiration and the person’s current 
state, the person may choose to invest very little. They refer to this state as “aspirations frustration” 
or “aspirations failure.’ Ross (2019) shows empirical evidence of this phenomenon in rural India. 
Leight et al. (2021) show that an intervention to raise aspirations in Ethiopia, similar to that studied 
in Bernard et al. (2014), has no measurable effect on either aspirations or investment. In this study, 
we show that even if higher aspirations do map onto greater investment in education, they do not 


necessarily generate meaningful learning gains in the status quo. 


4.2.1. The SD metric vs. skill-based measures of learning 


Given the wide range of studies which use the SD metric to quantify learning gains (cf. McE- 
wan, 2014; Ganimian and Murnane, 2016; Glewwe and Muralidharan, 2016), using effect sizes to 
compare the relative effectiveness of interventions or inputs across contexts is alluring and, in prac- 
tice, common (Kremer and Holla, 2009; McEwan, 2014; Glewwe and Muralidharan, 2016; Evans 
and Yuan, 2020). Our findings in the previous section highlight another core result of our paper: 
in cases where learning levels are very low, using the test score SD metric can lead to incorrect 
conclusions about the importance of different learning inputs. 

Putting aside psychometric issues with the comparability of different tests (Furr, 2021), there 
are still at least two core difficulties with using the SD metric to compare learning gains across 


contexts. The first is that at very low levels of learning, a small absolute gain can be a large relative 
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gain. For example, as we show in Figure 2, the 0.30 SD gain is comprised of many very small gains 
in skills. We estimate that the same increase in the percentage of questions answered correctly from 
a mean of 60 in the endline test score would generate only a 0.20 SD gain. Second, as we show 
later in the paper, the gain in skills such as literacy or numeracy acquired from a given increment 
in test scores varies dramatically with the child’s position in the skill distribution. At the place in 
the distribution where almost all children in the status quo group are, however, it would require 
many multiples of that gain to generate a meaningful change in literacy. 

This difference in interpretation is important. Were we to have relied only on test score stan- 
dard deviations, we would have concluded that aspirations are a powerful predictor of learning 
gains. Using literacy, numeracy, and individual skill gains, however, we see that higher aspirations 
correspond to no greater likelihood of achieving literacy or numeracy, and only meager skill gains, 
during a crucial three year period in these children’s lives. 

In light of this, we argue that measures of skill acquisition are superior to test score SDs for an- 
alyzing learning gains in contexts of low baseline learning. Particularly for assessment of learning 
gains across contexts, the acquisition of early life skills such as familiar word reading or mastery 
of simple arithmetic tasks can be easily compared, particularly within the same language of assess- 
ment (Platas et al., 2014; Dubeck and Gove, 2015). Within contexts, grade-specific skill analysis, 
as in Muralidharan et al. (2019), takes a similar approach. At higher levels of schooling, Filmer 
et al. (2020) propose a tool, learning-adjusted years of schooling (also known as LAYS), which 
allows for cross-context comparison of learning gains. In the context of US schools, Hill et al. 
(2008) report a similar pattern of greater effect sizes at lower grade levels (and thus lower lev- 
els of baseline skill), further highlighting the difficulty of using the SD measure for cross-context 


comparisons.”! 


*lFocusing on the US context, Kraft (2020) provides excellent guidance on how, and when, to use effect sizes for 
such comparisons. 
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4.3 Bounding these estimates 


We argue that our estimates are likely to provide an upper bound for the true relationship between 
caregiver educational and career aspirations, educational investment, and child learning for these 
areas of rural Gambia. Aspirations for education and employment are often positively correlated 
with other hard-to-measure or unobservable traits — such as caregiver wealth, education, or other 
tastes and preferences — that are also positively correlated with child educational investment and 
outcomes (Bernard et al., 2014; Ross, 2019). Any confounding from such sources would cause 
our estimates to be exaggerated, relative to the true relationship (Wooldridge, 2016). Therefore, 
unless there exists some other important, unobserved trait which is negatively correlated with these 
specific aspirations and positively correlated with educational investment and learning outcomes 
(or vice versa), our estimates are probably larger in magnitude than the true relationship. This 
further emphasizes our main point that higher educational and career aspirations alone are likely 
insufficient to reach higher learning levels in this, and perhaps similar contexts. 

As described in Section 2.2, presence in our sample is conditional on the caregiver intending to 
enroll the child in school in the coming year.” This means that aspirations may differ importantly 
between the sample and the population of children in rural Gambia. Extrapolating to this popu- 
lation, we believe our estimates show a slightly different parameter. Specifically, our estimates 
of a in Table 5 are an upper bound on what a child in this population might enjoy were their 
caregivers to possess high aspirations. Our argument rests upon the assumption that the children 
excluded from our study by the eligibility criterion of caregiver enrollment intent at baseline are 
likely to have either a similar or worse learning trajectory than those we included in the study. This 
premise is supported by multiple studies showing negative consequences in terms of learning and 
educational attainment stemming from late school enrollment in similar contexts (cf. Glewwe and 


Jacoby 1995; Bommier and Lambert 2000). 


>2Tn our sample, this eligibility criterion excluded roughly 13 percent of children at baseline who would otherwise 
be eligible according to our two remaining eligibility criteria: one, the child’s age; and two, their not having previously 
attended school at grade 1 or higher. 
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5 Consequences of increasing the quality of educational supply 


In this section, we show how the mapping from aspirations to learning outcomes changes when a 
key constraint — that of low quality educational supply — is relaxed. We also estimate the extent to 


which the relaxation of this constraint impacts caregiver aspirations at endline. 
5.1 Aspirations, learning, and educational supply 


We first estimate how the mapping from baseline aspirations onto later learning outcomes changes 
when the quality of educational supply is dramatically improved by receipt of a bundled, supply- 
side intervention. In Figure 3, we plot the distribution of test scores among the four relevant groups 
— high and low aspirations children who did and did not receive the intervention, respectively. As 
in Figure 1, we show separate panels for educational and career aspirations. In both plots, and for 
both treatment assignments, we find that higher baseline aspirations map onto higher endline test 
scores. 

We then estimate Equation 2 using data from the entire sample, i.e., both the status quo and 
intervention groups. We show these results in Table 6, using the three summary learning outcomes 
— standardized test scores, literacy, and numeracy — studied in Section 4. In Panel A, we show 
these results for educational aspirations; in Panel B, we show them for career aspirations. 

The first core finding is that the effect of the external intervention on learning dwarfs the map- 
ping from higher baseline aspirations to learning. In terms of raw points on the test, the intervention 
generates a gain that is more than an order of magnitude larger than the low aspirations—high aspi- 
rations differential. In terms of literacy and numeracy, we estimate intervention-driven gains of of 
between 17 and 25 percentage points from a counterfactual case of essentially zero likelihood of 
demonstrating either skill. 

The second core finding is that the mapping from baseline educational aspirations to endline 
literacy and numeracy is large and significant in the presence of high quality educational supply. 
Informally, the intervention dramatically raises the platform from which high aspirations care- 


givers reach to help their children on to greater learning. As shown in Figure 1, the mapping from 
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Figure 3: Distribution of endline test scores, by baseline aspirations and receipt of intervention 
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Figure 3 notes: this figure shows kernel density plots of endline test scores for children whose 
caregivers did and did not express the aspiration listed in the panel title at baseline, and within 
these groups, for children who were and were not resident at baseline in a village which was 
randomly assigned to receive the intervention, as indicated in the figure legends. The vertical lines 
show the mean test score of the group whose distribution is plotted with the same width, color, and 
pattern of line. 
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Table 6: How the mapping from baseline aspirations to learning varies in the presence of a large 
supply-side intervention 


(1) (2) (3) 
Endline Childis Child is 
test score literate numerate 
Panel A: Educational aspirations 


Baseline aspirations x intervention 0.39 0.06*** = 0.04" 
(1.58) (0.02) (0.02) 


Aspirations 3.65*** -0.00 -0.00 
(0.92) (0.00) (0.01) 


Intervention 45.52***  Q.23*** OL 7** 
(1.74) (0.02) (0.02) 


Comparison group mean 14.96 0.00 0.01 
Number of observations 3,814 3,814 3,813 


Panel B: Career aspirations 


Baseline aspirations x intervention  -2.44* 0.03 0.01 
(1.32) (0.02) (0.02) 


Aspirations 3.86%** 0.00 0.00 
(0.64) (0.00) (0.00) 


Intervention 47.33*** Q.25*** 0.18 *** 
(1.68) (0.03) (0.02) 


Comparison group mean 14.60 0.00 0.00 
Number of observations 3,814 3,814 3,813 


Table 6 notes: this table reports our estimates of the parameters in Equation 2 for the outcomes 
listed in the column headings. The panel titles indicate which baseline aspiration was used to 
generate the estimates shown. Coefficient estimates are reported according to the row title. We 
report clustered standard errors in parentheses below each estimated coefficient. Each panel x 
column “cell” corresponds to a separate regression. Comparison group means are calculated for 
those in the status quo group whose caregiver did not express the aspiration given in the column 
title at baseline. *p < 0.10, **p < 0.05, ***p < 0.01. 
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higher baseline aspirations to greater endline test scores leaves the child very far from achieving 
literacy or numeracy. As we can see in both Figure 3 and Table 7, conditional on receiving the 
dramatic improvement in the quality of educational supply provided by the intervention, baseline 
educational aspirations lead to a four to six percentage point (or 24 to 26 percent) greater likelihood 
of attaining literacy and numeracy at endline. We see a smaller, positive, but statistically insignif- 
icant relationship between baseline career aspirations and literacy and numeracy, conditional on 
receiving the intervention. 

In Tables 7 and 8, we show estimates of these relationships for each subtask in reading and 
math, respectively. Here again we focus on the B3 coefficient — the interaction between baseline 
aspirations and receipt of the intervention. In both of these tables, we see evidence of a positive 
gradient in the interaction term as skill difficulty increases. For easier subtasks, such as letter 
and number recognition (reading and math subtask 1, respectively), we estimate a statistically 
significant negative interaction term. For more difficult subtasks, however, the estimates become 
positive and increase in magnitude. For the two most difficult subtasks — reading and math subtasks 
5b; reading comprehension and two digit subtraction with borrowing, respectively — we estimate a 
large and statistically significant positive interaction term.”* This suggests that for the acquisition 
of simpler skills, the intervention appears to be a substitute for baseline aspirations, while for more 


difficult skills, the two appear to be complements. 


5.1.1 Alternative explanations 


We next address a few potential alternative explanations for our key results. The first is unobserved 
child ability. One potential explanation is that, instead of measuring aspirations, we are measuring 
some dimension of the child’s ability that is observable to the parent but not the econometrician. 
While possible, we argue this is unlikely to be the main explanation for several reasons. First of 
all, because more than three quarters of caregivers have never been to school, and over 90 percent 


of them cannot read a short, simple sentence, it is highly unlikely that parents are able to identify 


3Subtask 6 on both tests has no written component, making it somewhat different than all other subtasks, and less 
difficult in practice than other higher-level subtasks. *p < 0.10, **p < 0.05, ***p < 0.01. 
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Table 7: How the mapping from baseline aspirations to endline reading skills varies in the presence 
of a large supply side intervention 


Subtask Subtask Subtask Subtask Subtask Subtask Subtask 
1 2 3 4 Sa 5b 6 


Panel A: Educational aspirations 


Baseline aspirations x -1.745 -1.044 2.322 3.418 3.191 4.264** -0.651 
intervention (1.936) (2.057) (1.885) (2.223) (2.122) (2.075) (2.273) 
Baseline aspirations 3.349%* = 4.095*** 1.648* 2.421*** = 2.400*** 1.226** 1.052 


(1.276) (1.272) (0.841) (0.841) (0.866) (0.543) (0.872) 


Intervention 55.73 7*** 24.628*** 4S 475*#* ST STS SA. 428% AD DIT ERK S6.889%%* 
(2.143) (2.082) (1.874) (2.227) (2.251) (2.075) (2.436) 


Comparison group mean 37.820 37.261 25.238 30.705 29.915 21.682 31.135 
Number of observations 3,683 3,683 3,683 3,683 3,683 3,683 3,683 


Panel B: Career aspirations 


Baseline aspirations x -4.123** -0.633 -1.305 -1.228 -1.176 0.503 -1.368 
intervention (1.566) (1.940) (1.641) (1.736) (1.621) (1.804) (2.296) 
Baseline aspirations 4.355*** = 3.504*** = 2.332***  2.482*** 2. 386***  —1.664*** = 2.4220 *#* 


(0.878) (1.252) (0.562) (0.597) (0.582) (0.380) (0.685) 


Intervention 57.332*** 24. 367%** 47.727*** 60.433%** STLI4 EE 44 4gguee 57 382%%* 
(2.011) (2.097) (1.963) (2.071) (2.054) (2.076) (2.414) 


Comparison group mean 37.656 37.404 25.632 31.591 30.752 22.279 30.365 
Number of observations 3,683 3,683 3,683 3,683 3,683 3,683 3,683 


Table 7 notes: this table shows results for estimating Equation 2 for children’s scores on the in- 
dividual reading subtasks; panel titles indicate which aspiration is being studied. The dependent 
variable in each column is the subtask listed in the column heading; subtasks are described in Table 
A.1. We report clustered standard errors in parentheses below each estimated coefficient. The tests 
are shown in their entirety in Appendix A, divided by subtasks and with subtask indicated at the 
top of each relevant block of questions. The possible values of each subtask score range from zero 
to 100 percent of questions answered correctly. *p < 0.10, **p < 0.05, ***p < 0.01. 


31 


Table 8: How the mapping from baseline aspirations to endline math skills varies in the presence 
of a large supply side intervention 


Subtask Subtask Subtask Subtask Subtask Subtask Subtask Subtask 
1 2 3 4a 4b Sa 5b 6 


Panel A: Educational aspirations 


Baseline aspirations x -5.304** -4.032* 3.385* 0.660 2.873 1.619 7.364 *** -0.193 
intervention (2.273) (2.242) (1.729) (1.955) (2.194) (1.880) (2.474) (2.031) 
Baseline aspirations TA62*** = 7.650*** = 2.276** = 3.431*** — 2. 859*** — 3.0 70*** 1.046 5.416*** 


(1.983) (1.827) (0.894) (1.070) (0.788) (0.811) (0.681) (1.131) 


Intervention 49.649*** 49.716*** 41.106*** 46.540*** 56.763*** 39.007*** 47.004*** 26.923*** 
(2.866) (2.786) (1.773) (2.128) (2.169) (1.611) (2.260) (1.972) 


Comparison group mean 64.822 57.450 35.478 36.491 32.851 25.710 24.955 34.343 
Number of observations 3,682 3,682 3,682 3,682 3,682 3,682 3,682 3,682 


Panel B: Career aspirations 


Baseline aspirations x -6.4808** — -7,.478*** -1.931 -3.558* -2.731 -2.445 2.114 -2.499 
intervention (2.026) (1.909) (1.560) (2.002) (2.184) (1.700) (2.418) (2.000) 
Baseline aspirations T.2T9RRE — 8 BOS*RE —- 3B.O2DORHE SSB TERE 4 BDO*HE —_B_SOO*HE = LLSDT#RE 4 OS 8H 


(1.713) (1.576) (0.749) (1.045) (0.847) (0.682) (0.533) (1.040) 


Intervention 50.567*** = 52.063*** 44.406*** 49.237*** 60.274*** 41. 558*** S0.108***  28.376*** 
(2.694) (2.544) (1.877) (2.145) (2.405) (1.725) (2.517) (2.081) 


Comparison group mean 65.094 57.615 36.279 36.287 33.057 26.468 25.887 35.698 
Number of observations 3,682 3,682 3,682 3,682 3,682 3,682 3,682 3,682 


Table 8 notes: this table shows results for estimating Equation 2 for children’s scores on the in- 
dividual math subtasks; panel titles indicate which aspiration is being studied. The dependent 
variable in each column is the subtask listed in the column heading; subtasks are described in Ta- 
ble A.1. We report clustered standard errors in parentheses below each estimated coefficient. The 
tests are shown in their entirety in Appendix A, divided by subtasks and with subtask indicated at 
the top of each relevant block of questions. The possible values of each subtask score range from 
zero to 100 percent of questions answered correctly. *p < 0.10, **p < 0.05, ***p < 0.01. 
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academic skill at the time when baseline aspirations are measured, prior to the child’s first ever 
enrollment in school. Second, the educational investment behavior of caregivers corresponds to 
aspirations in a way that is consistent with the investment response to an experimentally-generated 
increase in aspirations as measured in Bernard et al. (2014). Third of all, while career and ed- 
ucation aspirations both predict subsequent investment behavior, they are only mildly correlated 
(correlation 0.18). Finally, we can look within families at how much aspirations vary, as a proxy 
for unobservable (to us) within-family differences in ability that may manifest as aspirations differ- 
ences. There are 151 caregivers in our sample with multiple study children. In 92 percent of these 
cases, the caregiver expresses the same educational aspirations for each child under their care. In 
70 percent of these cases, the caregiver expresses the same career aspirations for each child under 
their care. This suggests that, in the vast majority of cases, our aspirations data capture family de- 
sires for their children’s futures, rather than serving as a proxy for family beliefs about individual 
child ability. 

The second potential alternative explanation is that some broader, more latent socioeconomic 
variable is what drives the interaction between baseline aspirations and the supply-side interven- 
tion. In other words, it could be unobserved family wealth or other omitted caregiver traits that 
generate the greater ability of children of high aspirations caregivers to reach literacy and numer- 
acy in the presence of the intervention. Here also, multiple pieces of evidence suggest this is not 
the case. First, we see evidence of baseline educational aspirations leading to greater likelihood 
of literacy and numeracy in the presence of the intervention, but no such relationship for career 
aspirations. Second, we conduct a robustness test which estimates an alternative version of Table 
6 after adding interactions between the intervention and household wealth, caregiver education, 
caregiver literacy, and the presence of books in the home. We present these results for baseline 
educational and career aspirations in Tables A.4 and A.5, respectively. These show that the main 
patterns we observe in Table 6 are robust to the inclusion of these other predictors of a potential 
response to the presence of the intervention. In other words, for a reasonable set of observable 


controls, we show that there is still a residual in the learning outcomes we study to be explained 
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Table 9: How a large increase in the quality of educational supply affects endline aspirations 


Aspiration: 

(1) (2) 
Child will Child will 
attend work in 
university urban area 


Effect of intervention on endline 0.060*** 0.005 
aspirations (0.023) (0.021) 

Control group mean aspiration at endline 0.60 0.53 

Number of observations 3,718 3,718 


Table 9 notes: this table reports our estimates of whether the intervention had an impact on end- 
line aspirations, controlling for baseline aspirations, as described in Section 3. The column titles 
indicate which baseline aspiration was used to generate the estimates shown. Coefficient estimates 
are reported according to the row title. We report clustered standard errors in parentheses below 
each estimated coefficient. There are slightly fewer observations in this table (3,720) than in the 
previous figure and tables (3,850) because there are 130 children for whom we are missing endline 
aspirations data. Comparison group means are calculated for those in the status quo group whose 
caregiver did not express the aspiration given in the column title at baseline. *p < 0.10, **p < 0.05, 
met p= O01, 

by aspirations which is not explained by the interaction of the intervention and these other traits of 


the children and their families which also predict learning. 


5.2 Does an increase to the quality of educational supply affect aspirations? 


Finally, we show how receipt of the intervention impacts aspirations over the course of the study. 
In India, Mexico, and Nicaragua, external shocks were found to raise parental aspirations for their 
children (Beaman et al., 2012; Macours and Vakis, 2014; Garcia et al., 2019). To examine the 
possibility that the supply-side intervention here might have stimulated rural Gambian caregivers’ 
aspirations for their child’s future, we estimate a slightly modified version of Equation 2, as de- 
scribed in Section 3. Our main outcome variables are the same educational and career aspirations 
discussed earlier, measured at endline. We present our results in Table 9. 

We find that the para teacher intervention has a positive and statistically significant effect on 
endline educational aspirations, but no measurable effect on endline career aspirations. Our es- 


timates suggest that caregivers whose children receive the intervention are 6.2 percentage points 
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more likely to aspire to send their child to university at endline than those who do not. Because the 
endline level of aspirations for sending a child to university in the status quo group is 60 percent, 
this comprises a roughly ten percent difference. In contrast, we find no evidence that receiving the 


intervention leads to a change in caregiver aspirations for the child’s career. 
6 Conclusion 


In this paper we study a common desire that many families across the world have: the aspiration 
that their children will go on to live better lives than those lived by previous generations. We char- 
acterize the relationship between this desire, subsequent educational investment, and later learning 
in a very low income context. We first show that many families in this context posses this desire 
and act on it, investing more in their children’s education even in the face of the extremely high op- 
portunity cost of investment. We show that these investments can lead to a much greater likelihood 
of achieving literacy and numeracy by the end of the third grade, but only when complementary re- 
sources on the supply side are present. This finding belies the notion that families in such contexts 
merely need to wish and try to “pull themselves up by their bootstraps.” 

We also show that, when baseline learning levels are very low, the widely used measure of test 
score standard deviations can lead to incorrect conclusions about how educational inputs do or do 
not generate meaningful differences in learning. We find that, in this context, the test score standard 
deviation generated a spuriously optimistic assessment of the relationship between aspirations and 
learning outcomes. We argue that in such contexts with very low counterfactual learning levels, 
skill-based measures of learning gains may be more accurate in capturing the importance of various 
educational inputs and the impact of interventions. 

Overall, our research highlights an important feature of the educational experience of children 
and their families in extremely resource poor contexts such as the one we study. As is the case 
across the world, many caregivers in our sample wish to improve the livelihoods of their children 
and help them reach a prosperous adulthood. We show that these caregivers expend dear financial 


resources to do so, both in terms of money and their children’s time. These investments yield a 
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significant return in terms of the child’s performance on literacy and numeracy tests, relative to 
that of their peers. Sadly, because counterfactual learning levels are so low, these relative gains 
still leave children dramatically short of reaching literacy and numeracy, among the most crucial 
skills for reaching later economic productivity and participating in many spheres of society. With 
the presence of complementary inputs on the supply side, however, these same aspirations map 
onto far greater likelihood of the child being able to read with understanding and conduct basic 
arithmetic. For policy, this suggests that while the demand side can yield important learning gains 
in low income contexts, substantial increases in the quality of educational supply will also be 
necessary to address the very low levels of learning in the many pockets of extreme poverty in the 


developing world. 
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Appendix 


Table A.1: Test subtasks 


Reading 


Math 


Subtask 


Example 


Subtask Example 


1 


Sa 


5b 


Read a letter’s sound 
(e.g., “eh” for e) 


Differentiate sounds 
(e.g., which word starts with a 
different sound: book, dog, or boy) 


Read a made-up word 
(e.g., tob) 


Read a familiar word 
(e.g., but) 


Read a short passage 
Answer questions on the passage’s 
content 


Listen to a different short passage, answer 
questions on the passage’s content 


1 


4a 


4b 


5a 


5b 


Read a number 
(e.g., 1, 5, 22) 


Choose the larger number 
(e.g., 7 or 5) 
Complete a sequence 


(e.g.,246__) 


Simple addition 
(e.g., 3+2) 


Two- and three-digit addition 
(e.g., 38+26) 


Simple subtraction 
(e.g., 5-3) 


Two- and three-digit subtraction 
(e.g., 59-37) 


Solve a simple word problem 
read aloud 


Table A.1 notes: this table describes the individual “subtasks” within the reading (EGRA) and 
math (EGMA) tests administered at endline. The full test papers are given in Appendix A; the 
relevant subtask number for each block of questions is indicated in the test papers. 
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Table A.2: Mapping of aspirations at baseline to individual reading subtask performance in the 
status quo group 


Subtask Subtask Subtask Subtask Subtask Subtask Subtask 
1 2 3 4 Sa 5b 6 


Panel A: Educational aspirations 


High baseline 3.132** 3.664*** 1.516*  2.380***  2.210** = 1.267** 1.123 
educational aspirations (1.311) (1.275) (0.854) (0.872) (0.894) (0.559) (0.890) 


Comparison group mean =:11.592 25.741 3.744 3.729 4.371 2.028 4.309 


Number of observations 1,971 1,971 1,971 1,971 1,971 1,971 1,971 


Panel B: Career aspirations 


High baseline 4ATT#** = 3.172** — 2,.292*** 2.620*** 2.383*** 1,794 *** 2.343% 
career aspirations (0.850) (1.253) (0.559) (0.598) (0.576) (0.347) (0.655) 


Comparison group mean 10.884 25.949 3.295 3.499 4.183 1.671 3.494 


Number of observations 1,971 1,971 1,971 1,971 1,971 1,971 1,971 


Table A.2 notes: this table shows results for estimating Equation 1 for children’s scores on the indi- 
vidual reading subtasks. We report clustered standard errors in parentheses below each estimated 
coefficient. The dependent variable in each column is the subtask number listed in the column 
heading. Subtasks are described in Table A.1. The tests are shown in their entirety in Appendix 
A, divided by subtasks and with subtask indicated at the top of each relevant block of questions. 
The possible values of each subtask score range from zero to 100 percent of questions answered 
correctly. *p < 0.10, **p < 0.05, ***p < 0.01. 
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Table A.3: Mapping of aspirations at baseline to individual math subtask performance in the status 
quo group 


Subtask Subtask Subtask Subtask Subtask Subtask Subtask Subtask 
1 2 3 4a 4b Sa Sb 6 


Panel A: Educational aspirations 


High baseline 6.804*** 7.031*** 2.104**  3.072*** 2.652*** 2.770%** 0.847 5.112*** 
educational aspirations (2.001) _—(1.842) _~—- (0.922) _—s (1.095) _—- (0.776) _~—s (0.844) ~—s- (0.645) _— (1.143) 


Comparison group mean 41.153 33.866 16.109 14.594 6.337 7414 2.978 21.779 


Number of observations 1,970 1,970 1,970 1,970 1,970 1,970 1,970 1,970 


Panel B: Career aspirations 


High baseline 6.670*** 8.180"** 2.941*** 5,215*** 4.660*** 3.230*** 1.428*** 3, 857%** 
career aspirations (1.713) (1.564) (0.742) (1.026) (0.793) (0.652) (0.504) (1.037) 


Comparison group mean 41.183 33.074 15.623 13.371 4.958 7.132 2.597 22.450 


Number of observations 1,970 1,970 1,970 1,970 1,970 1,970 1,970 1,970 


Table A.3 notes: this table shows results for estimating Equation | for children’s scores on the 
individual math subtasks. We report clustered standard errors in parentheses below each estimated 
coefficient. The dependent variable in each column is the subtask number listed in the column 
heading. Subtasks are described in Table A.1. The tests are shown in their entirety in Appendix 
A, divided by subtasks and with subtask indicated at the top of each relevant block of questions. 
The possible values of each subtask score range from zero to 100 percent of questions answered 
correctly. *p < 0.10, **p < 0.05, ***p < 0.01. 
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Table A.4: How the mapping from baseline educational aspirations to learning varies in the pres- 
ence of a large supply-side intervention, adding interactions with various other predictors of learn- 


ing 


(1) (2) (3) 
Endline Childis Child is 
test score literate numerate 
Baseline educational aspirations x intervention 0.32 0.06*** = 0.04% 
(1.53) (0.02) (0.02) 
Baseline educational aspirations x household wealth 2.30 0.01 0.02 
(1.71) (0.03) (0.03) 
Baseline educational aspirations x caregiver has -0.00 -0.05* = -0.04** 
never been to school (1.43) (0.03) (0.02) 
Baseline educational aspirations x caregiver cannot 1.85 -0.01 0.05 
read simple sentence (2.89) (0.05) (0.05) 
Baseline educational aspirations x books in house Saf Lee 0.02 0.05*** 
(1.26) (0.02) (0.02) 
Baseline educational aspirations -L.11*** 0.03 -0.05 
(2.93) (0.05) (0.04) 
Household wealth -0.36 0.01 -0.02 
(1.31) (0.01) (0.02) 
Caregiver has never been to school -0.27 0.05** 0.02 
(1.19) (0.02) (0.01) 
Caregiver annot read simple sentence -5.16** -0.02 -0.02 
(2.42) (0.04) (0.04) 
Books in house -0.50 -0.02 -0.02 
(1.23) (0.02) (0.02) 
Intervention 45.58*** O.23*** 0.1 7*** 
(1.71) (0.02) (0.02) 
Comparison group mean 14.96 0.00 0.01 
Number of observations 3,814 3,814 3,813 


Table A.4 notes: this table shows results for estimating Equation 2 after adding the interaction 
terms shown here. This is an analog to Panel A of Table 6, adding the interaction terms shown here 
to test whether, for a reasonable set of observable controls, there is still a residual in the learning 
outcomes we study to be explained by aspirations which is not explained by the interaction of 
the intervention and other traits of the children and their families which also predict learning. 
We report clustered standard errors in parentheses below each estimated coefficient. *p < 0.10, 
**p < 0.05, ***p < 0.01. 
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Table A.5: How the mapping from baseline career aspirations to learning varies in the presence of 
a large supply-side intervention, adding interactions with various other predictors of learning 


(1) (2) (3) 
Endline Childis Child is 
test score literate numerate 


Baseline career aspirations x intervention -2.39* 0.03 0.01 
(1.32) (0.02) (0.02) 


Baseline career aspirations x household wealth 1.65 0.00 -0.02 
(1.48) (0.02) (0.02) 


Baseline career aspirations x caregiver has 1.77 -0.03 -0.04 
never been to school (1.95) (0.02) (0.03) 
Baseline career aspirations x caregiver cannot -3.93 -0.06 -0.01 
read simple sentence (3.13) (0.04) (0.05) 
Baseline aspirations x books in house 1.58 0.00 0.00 


(1.40) (0.02) ~—- (0.02) 


Baseline career aspirations 4.69* 0.08* 0.04 
(2.84) (0.04) (0.04) 


Household wealth -0.13 0.01 0.00 
(1.29) (0.02) (0.02) 


Caregiver has never been to school -1.61 0.03 0.02 
(1.67) (0.02) (0.03) 


Caregiver annot read simple sentence -1.02 0.02 0.02 
(2.52) (0.04) (0.05) 


Books in house 0.79 -0.01 0.00 
(1.19) (0.02) (0.02) 


Intervention 47.26*** O.25*** 0.18 *** 
(1.67) (0.03) (0.02) 


Comparison group mean 14.60 0.00 0.00 


Number of observations 3,814 3,814 3,813 


Table A.5 notes: this table shows results for estimating Equation 2 after adding the interaction 
terms shown here. This is an analog to Panel B of Table 6, adding the interaction terms shown here 
to test whether, for a reasonable set of observable controls, there is still a residual in the learning 
outcomes we study to be explained by aspirations which is not explained by the interaction of 
the intervention and other traits of the children and their families which also predict learning. 
We report clustered standard errors in parentheses below each estimated coefficient. *p < 0.10, 
**p <0.05, *“*p < 0.01. 
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Figure A.1: Regions of The Gambia and study area 


Panel A: The Gambia’s location in West Africa 


Banjul 
Central River 


North Bank 


Upper River 


Small villages in these two regions 


Panel B: Study area with The Gambia 


Figure A.1 notes: this figure shows the location of our study area. In Panel A, we show a map of 
the continent of Africa with The Gambia shown within the red circle. In Panel B, we show a map 
of the Gambia, indicating the two regions where the study took place. 
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For Online Publication: Appendix A: Test papers 


Test papers begin on next page 
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yA 


Effective Intervention 


SCORE | EGMA The Gambia, May 2018 


Early Grade Math Assessment in The Gambia: Instructions for Enumerators and 


Children Response Form 
General Instructions 


It is important to establish a playful and relaxed relationship with the child through an initial talk on topics 
of interest to the child (follow the text in bold below). The child should perceive the assessment more as a 
game rather than an evaluation. It is important that you ONLY read aloud the text in bold, slowly and clearly, 
so that the child can understand the exercises. 


Good morning. My name is . And you, what’s your name? | like to . And 


you, what do you like to do? Now that you have done some reading games with my colleague, let’s 
do some Maths game. Throughout this exercise, you can answer in the language that you prefer. Is 
that ok? [wait until the child responds] Are you ready? [wait until the child responds] Let’s start. 


Assessment start time: hh: 


Subtask 1. Number identification 


(Ce Page 1 


60 seconds 


@ In this sheet there are some numbers. When | say “start”, start here [point to 
the first number], and read through the page [sweep finger across first line]. Point to 
each number and read out loud. | will use this timer and will tell you when to 
stop. Read as fast and the best you can. If there is one number you can’t read, 
move to the next one. Put your finger in the first one [make sure the child does so 
and prepare to time]. Are you ready? [wait until the child replies] You can start. 


48 (/) = Mark any incorrect number or no response with a slash ( / ). 
(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(J) = Mark the final number read with a bracket (J ). 


2 9 0 12 30 
22 45 39 23 48 
91 33 74 87 65 

108 245 587 731 989 


Start the timer 
when the child 
reads the first 
letter. 


W When the timer 
reaches O, say 
“stop.” 


> If the child 
hesitates for 5 
seconds, say the 
number and then 
point to the next 
item and say “Go 
on”. Mark the 
number that you 
provided as 
incorrect. 


4 Time remaining on timer at completion (SECONDS): 


NA1: NE1: 


4S Which languages did the child use in this task? (circle all answers that apply) 


English Pulaar Mandinka Olof Others (please specify) 


Thank you, let’s move to the next task. 


yA 
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Subtask 2. Number discrimination (PRACTICE) 


(Ce Page 2 


® Look at these numbers. Say which number is bigger [the child can only be 
considered correct if he/she “says” the bigger number, pointing is not enough]. 


8 4 
va [If the child answered 8, say] Well done, 8 is bigger. Let’s try another 
example. 
x a [If the child did not answer 8, say] The bigger number is 8. [Point to 8] This 
is 8. [Point to 4] This is 4. 8 is bigger than 4. Let’s try another example. 


® Look at these numbers. Say which number is bigger. 


10 12 
¥ & [If the child answered 12, say] Well done, 12 is bigger. Let’s continue. 
x 2 [If the child did not answer 12, say] The bigger number is 12. [Point to 10] 
This is 10. [Point to 12] This is 12. 12 is bigger than 10. Let’s continue. 


Subtask 2. Number discrimination (TEST) (4) Page 3 


© x 


Look at these numbers. Say which number is bigger. [repeat for each item] 


4S (v) 1 = Correct 
(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(4) = Mark the final answer provided with a bracket (J ). 


(¥’) 0 = Incorrect or without answer 


Lie Ss 7) | 1 Io 
2711 24 24) | 110 
3 147 34 47) | 110 
415g 49 58) | 1/0 
5 165 67 67| | 1/0 
6/94 78 94) | 1/0 
7 1146 153 153; 1/0 
8 1287 534 534, 1/0 
9 1623 632 632| | 1/0 
10/867 965 965) 1/0 


W If the child makes 
4 successive errors at 
any point, say “thank 
you”, discontinue this 
subtask, mark below 
and move to the next 
subtask. 


> If the child 
hesitates for 5 
seconds, provide the 
answer and then 
point to the next 
item and say “Go 
on”. Mark the item 
that you provided 
answer as incorrect. 


4S Exercise discontinued because the child made 4 successive mistakes.[ | 


NE2: 


NA2: 


45 hich languages did the child use in this task? (circle all answers that apply) 


English Pulaar Mandinka Olof Others (please specify) 


Thank you, let’s move to the next task 


yA 
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Subtask 3. Missing Number (PRACTICE) (Cy Page 4 


P1& Here are some numbers. 1, 2 and 4, what number goes here [point to the 
empty box]? 


1 2 (3) 4 


va [If the child answered 3, say] Well done, it’s 3. Let’s do another one. 


x a [If the child did not answer 3, say] The number 3 goes here. Say the 
numbers with me [point to each number]. 1, 2, 3 and 4. 3 goes here. Let’s try 
another one. 


P2 & Here are some numbers. 5, 10 and 15, what number goes here? 


5 10| | 15] | (20) 


va [If the child answered 20, say] Well done, it’s 20. Let’s continue 

x a [If the child did not answer 20, say] The number 20 goes here. Say the 
numbers with me [point to each number]. 5, 10, 15 and 20. 20 goes here. Let’s 
continue. 


yA 
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oe Page 5 and 6 


© x 


® If the child makes 
4 successive errors at 
any point, say “thank 
you”, discontinue this 
subtask, mark below 
and move to the next 
subtask. 


> If the child 
hesitates for 5 
seconds, provide the 
answer and then 
point to the next 
item and say “Go 
on”. Mark the item 
that you provided 
answer as incorrect 


O 


Subtask 3. Missing Number (TEST) 
Here are some numbers [point to the box]. What number goes here? 
[repeat for each item] 
4S (Vv) 1 = Correct 
(v’) 0 = Incorrect or without answer 
(@) Mark with a circle the self-corrections if you already marked as incorrect. 
(J) = Mark the final answer provided with a bracket (J ). 
1. 
5 6 7 (8) 0 
2. 
14 | | 15 | | (16)| | 17 1/0 
3. 
20 (30) 40 50 1/0 
A. 
(200) 300 | | 400 500 1 | 0 
5. 
2 4 6 (8) 0 
6. 
348 349 (350) 351 1/0 
7. 
28 | | (26)| | 24] | 22 1/0 
8. 
30 | | 35) | (40)| | 45 1] 0 
9. 
550 540 530 (520) 1|0 
10. 
3 8 | |(13)] | 18 1/0 
4S Exercise discontinued because the child made 4 successive mistakes. 
NA3: NE3: 
4 Which languages did the child use in this task? (circle all answers that apply) 
English Pulaar Mandinka Olof 


Others (please specify) 


Thank you, let’s move to the next task. 


yA 
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Subtask 4a. Addition (level 1) (CE) Page 7 and 8 


60 seconds 


eo 
D A Paper and pencil 


& In these two pages there are some addition questions [glide hand from top 
to bottom on the two pages]. You should start here [point to the first problem]. | 
will use the timer and will tell you when to start and when to stop. Say the 
answer for each question. If you don’t know an answer, move to the next 
problem. If you want, you can use this paper and pencil. Are you ready? [wait 
until the child responds and prepare to time] Start. 


4S (v) 1 = Correct 
(v’) 0 = Incorrect or without answer 


(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(4) = Mark the final answer provided with a bracket (J ). 


1 3+2=(5) flo oe. 7eesc5) 1| 0 
2 1+3=(4) ilo /| | 4*#7=(14) 1] 0 
3 4+5=(9) mice. || 2° | 2 le) 1] 0 
4 6 +2=(8) rales 144); 8+6=(14) 1/0 
5 8 +1=(9) le 15 | 9+8=(17) 1| 0 
6 3+3=(6) ‘le | =e | eee = (13) 1] 0 
7 7 +3=(10) 1/0 17) 8+8=(16) at | =f 
8 34+9=(12) il @ 18} 8+5=(13) 1| 0 
9 2+8=(10) a6 19} 10+2=(12) 1] 0 
10] 943 =(12) tl. || | Se a0 = (18) 10 
The child used: 

Fingers to count. 

Paper and pencil. 

Solved the question in his/her head. 


TickY all answers that apply. 


Start the timer when 
you say “start”. 


©@ When the timer 
reaches 0, say “stop.” 


W If the child makes 
4 successive errors at 
any point, say “thank 
you”, discontinue this 
subtask, mark below 
and move to the next 
subtask. 


> If the child 
hesitates for 5 
seconds, provide the 
answer and then 
point to the next 
item and say “Go 
on”. Mark the item 
that you provided 
answer as incorrect. 


&S Time remaining on timer at completion (SECONDS): 


45 Exercise discontinued because the child made 4 successive mistakes. [] 


NA4a: NE4a: 


English Pulaar Mandinka Olof Others (please specify) 


4S Which languages did the child use in this task? (circle all answers that apply) 


Thank you, let’s move to the next task. 
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Subtask 4b. Addition (level 2) 


(4 Page 9 


© x 


o 
D 4 Paper and pencil 


= Here are some addition questions [glide hand from top to bottom]. Tell me 
the answer for each question. If you do not know the answer, move to the 
next one. If you want, you may use this paper and pencil. Are you ready? 
[wait until the child responds] Start here [point to the first problem] 


4S (v) 1 = Correct 


(VY) 0 = Incorrect or without answer 


Dn nN BP Ww NY FR 


13 + 6 = (19) 
18 +7 = (25) 
14 + 25 = (39) 
22 + 37 = (59) 
38 + 26 = (64) 


2344+512= (746) 


Pi Pl Pf Pf Pf PR 


oO;O;oO;oO;0/;/0 


The child used: 


Fingers to count. 


Paper and pencil. 


Solved the question in his/her head. 


Tick V all answers that apply. 


Skip this subtask if 
the child Scores zero 
in level 1 Addition 


questions. 


if the child makes 
4 successive errors, 
say “thank you”, 
discontinue this 
subtask, mark below 
and move to the next 
subtask. 


> | If the child uses 
an inefficient 
strategy (e.g. tick 
marks), ask the child 
“Do you know 
another way to solve 
the problem? If “no”, 
move to the next 
item after 5 seconds. 


> If the child does 
not provide answer 
in 30, point to the 
next item and say 
“Go on”. You may 
give additional 30 
second if the child is 
still processing the 
question. 


4S Exercise discontinued because the child made 4 successive errors. O 


NA4b: 


NE4b: 


English Pulaar 


Mandinka Olof 


4 Which languages did the child use in this task? (circle all answers that apply) 


Others (please specify) 


Thank you, let’s move to the next task. 


yA 
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Subtask 5a. Subtraction (level 1) 


aa Page 10 and 11 


60 seconds 


DB 4 Paper and pencil 


& In these two pages there are some subtraction questions [glide hand from 
top to bottom, showing the two pages]. You should start here [point to the first 
problem].! will use timer and will tell you when to start and when to stop. Say 
the answer for each question. If you don’t know an answer, move to the next 

question. If you want, you may use this paper and pencil. Are you ready? 
[wait until the child responds and prepare to time] Start. 


45 (Vv) 1 = Correct 


(W’) 0 = Incorrect or without answer 


(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(4) = Mark the final answer provided with a bracket (J ). 


1 5 -3=(2) 1/0 
2 4-1= (3) 1/0 
3 9-5=(4) 1/0 
7 8-2 =(6) 1/0 
3 9-8=(1) 1/0 
5 6-3 =(3) 1/0 
7 10 - 7 = (3) 1/0 
8 12 - 3= (9) 1/0 
3 10 - 2 = (8) 1/0 
10 | 12-9 =(3) 1/0 


44 
12 
13 
14 
15 
16 


15 - 7 =(8) 1/0 
11-4 =(7) 1/0 
12 - 7 = (5) 1/0 
14 - 8 = (6) 1) 
17 - 9 = (8) 10 
13 -6=(7) 1/0 
16 - 8 = (8) 1/0 
13 - 8 =(5) 1.| 0 
12 - 10 = (2) 1/0 
18 - 8 = (10) 1/0 


The child used: 


Fingers to count. 


Paper and pencil. 


Solved the questions in his/her head. 


Tick VY all answers that apply. 


Start the timer when 
you say “start”. 


& When the timer 
reaches 0, say “stop.’ 


y 


if the child makes 
4 successive errors, 
say “thank you”, 
discontinue this 
subtask, mark below 
and move to the next 
subtask. 


> If the child 
hesitates for 5 
seconds, provide the 
answer and then 
point to the next 
item and say “Go 
on”. Mark the item 
that you provided 
answer as incorrect 


45 Time remaining on timer at completion (SECONDS) 


is Exercise discontinued because the child made 4 successive mistakes. [] 


NA5a: 


NE5a: 


English Pulaar Mandinka Olof 


Others (please specify) 


4s Which languages did the child use in this task? (circle all answers that apply) 


Thank you, let’s move to the next task. 


yA 
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Subtask 5b. Subtraction (level 2) 


(Co Page 12 


Ox 


a A Paper and pencil 


= Here are some subtraction questions [glide hand from top to bottom]. Tell 
me the answer for each subtraction question. If you do not know an answer, 
move to the next one. If you want to, you may use this paper and pencil. Are 
you ready? [wait until the child replies] Start here (point to the first problem] 


(W) 1 = Correct 
(¥) 0 = Incorrect or without answer 


1 19 - 6 = (13) 4.0 
ye 25 - 7 = (18) 1 | 0 
3} 26-14=(12) 1/0 
4) 59-37 =(22) 1 | 0 
5| 64-26 = (38) 1/0 
6] 746 - 512= (234) 1 | 0 


The child used: 


Fingers to count. 


Paper and pencil. 


Solved the questions in his/her head. 


Tick Yall answers that apply. 


Skip this subtask if 
the child scores zero 


in Level 1 subtraction 
questions. 


© If the child makes 
4 successive errors, 
say “thank you”, 
discontinue this 
subtask, mark below 
and move to next 
task. 


> If the child uses an 
inefficient strategy 
(e.g. tick marks), ask 
the child “Do you 
know another way 
to solve the 
problem? If “no”, 
move to the next 
item after 5 seconds. 


> If the child does 
not provide answer 
in 30, point to the 
next item and say 
“Go on”. You may 
give additional 30 
second if the child is 
still processing the 
question. 


4S Exercise discontinued because the child made 4 successive mistakes. oO 


NASb: NE5b: 


4 Which languages did the child use in this task? (circle all answers that apply) 


English Pulaar Mandinka Olof Others (please specify) 
Thank you, let’s move to the next task. 
Subtask 6. Word problems (PRACTICE) CE x 


D A Counters, paper and pencil. 


= lam going to read some problems for you to solve them. If you want you 
can use these counters, paper and pencil. Listen carefully to each problem. If 
you need, | can repeat once. Are you ready? [wait until the child replies] Let’s 
start. 


© There are 3 children in the classroom [pause and check] 
1 child gets out of the classroom. [pause and check] 
How many children stay in the classroom? 


% x 


WyA 
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va [If the child answers 2, say] Well done, 2 children stayed in the 
classroom. Let’s continue. 

x a [If the child does not answer 2, Put 3 counters on top of the table and say] 
Imagine that these counters are children. One of the children gets out of the 
classroom. Show me the child getting out of the classroom. How many 
children stayed in the classroom? 

Well done, two children stayed in the classroom. Let’s continue. 


Subtask 6. Word Problems (TEST) ICE y x 


eo 
DB 4 Counters, paper and pencil. 


e . 
™ Now |! will read some more problems for you. 


(W) 1 = Correct (¥) 0 = Incorrect or no response 

1. & There is 1 child in the classroom. Another 3 coe ee ar at 

children get inside the classroom. How many (4) eanfonceta ake 

F : 1 . 

children are now in the classroom? © | | sure that the se 
understands what 

2. There are 8 balls in the bag. 2 are white and you have said before 

ee tinuing. Y 
the rest are red. How many red balls are inside (6) ee eee 
1 

the bag? : understand?” when 
in doubt. If the child 

3. Demba has 3 oranges. Awa has 6 oranges. requests, you may 

How many oranges do | have to give to Demba (3) repeat the question 


1/0 ONCE only. 


so that they have the same number of oranges? 


4.4There were 8 children in the classroom. Some 


more children got inside the classroom. Now (6) pate anata 
there are 14 children in the classroom. How 1 | 0 || say “thank you”, 
many children got inside the classroom? acceler 
5.1 have 15 bananas to share between 3 oe 

children. How many bananas should | give to (5) 

each child so that all of them get the same 1 | © || S ifthe child has 
number of bananas? ae 


than 60 seconds and 
not provided an 
answer, say “let us 
1/0 try another one” and 
move on to the next 
item and mark the 
item as incorrect. 


6. There are 6 tables in the classroom. At each 
table there are 2 children seated. How many 
children are in the classroom altogether? 


(12) 


The child used (Tick all answers that apply): 


Fingers to count. 


Counter 


Paper and pencil. 


Solved the problems in his/her head. 


4S Exercise discontinued because the child made 4 successive errors. O 


NA6: NE6: 


yA 
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48 Which languages did the child use in this task? (circle all answers that apply) 


English Pulaar Mandinka Olof Others (please specify) 


Thank you, you did a good job. Now please return to your own classroom/you can go home. 


4 Which language(s) did you use to apply this test? (circle all answers that apply) 
English Pulaar Mandinka Olof Others (please specify) 


Assessment end time: hh: mm 


Does the child have any visible/noticeable disability? (circle as appropriate) 
No Yes (please specify) 


hyA 
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Early Grade Reading Assessment in The Gambia: Instructions for Enumerators 
and Children Response Form 
General Instructions 


It is important to establish a playful and relaxed relationship with the child that will be assessed 
through an initial talk on topics of interest to the child (see example below). Use this time to 
identify whether the child is comfortable with the national language you use. The child should 
perceive the assessment more as a game rather than an evaluation. It is important that you do 
not deviate from the guidelines and ONLY read aloud the text in bold, slowly and clearly, so that 
the child can understand the exercises. 


“Good morning/afternoon. My name is and | work at Effective Intervention. 
And you, what’s your name? [wait until the child responds] How is your family? [wait until 
the child responds] When I am not at work, | like to . And you? What do you 


most enjoy doing when you are not at school? [wait until the child responds] 


Verbal Consent 


e Let me tell you why | am here today. | am working with a project of Effective 
Intervention. We came today to your school to do an exercise to help us better 
understand how children learn how to read and do mathematics, and you were 
chosen to help us. 

¢ We would like to ask for your help. But you do not have to take part if you do not 
want to. 

¢ We are going to play reading and mathematics games. | am going to ask you to read 
letters, words and a short story out loud. Then you will go to my friend/colleague 
sitting at the other side (point to the direction of the EGMA enumerator), and he/she 
will ask you to identify numbers, do some calculations and solve a few problems. 

¢ Sometimes | will use this timer to time how long it takes you to complete some of the 
tasks. If you hear it beeps, please do not pay attention to it. 

¢ This is NOT a test and it will not affect your grade at school. 

¢ Once we begin, if you would rather not answer a question, that’s all right. 


¢ Can we start? [wait until the child responds] 


If the oral consent is obtained, please tick: [| 
If the oral consent is not obtained, please make a note on the student list. 


Assessment start time: hh: mm 


SCORE / EGRA The Gambia 


hyA 


Effective Intervention 
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Subtask 1. Letter Sound Identification (=) Page 1 


60 seconds 


= Here is a page with many English letter sounds. Please tell me the SOUNDS 
of as many letters as you can- not the NAMES of the letters, but the SOUNDS. 


For example, [Point to “A”] this letter sound is /a/. 


Let’s practice. [Point to “T”] Tell me what letter sound this is. 
¥ @ [If the child read /t/, say] Very good, this letter sound is /t/. 
x a [If the child did not read /t/, say] This letter sound is /t/. 


[Point to “b”]. Now let’s try another one. Tell me what letter sound this is. 
V &@ [If the child read /b/, say] Very good, this letter sound is /b/. 
x @ [If the child did not read /b/, say] This letter sound is /b/. 


Have you understood? [wait until the child replies] 


When I say “start”, start here [point to the first letter], and read through the page 
[sweep finger across first line]. | will use this timer and will tell you when to stop. 
Point to each letter and read out loud the letter sound. Read as fast and the best 
you can. If there is a letter sound you can’t read, move to the next one. 


Put your finger on the first letter [make sure the child does so]. Are you ready? 
[wait until the child responds and prepare to time] You can start. 


4 ( /) Mark any incorrect words with a slash (/ ). 
(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(4) Mark the final letter read with a bracket (J ). 


Examples: A T b 

1 2 3 4 5 6 7 8 9 10 

Li iyhy RIS} y}E}O}w} T } ao 
i;e|T}|m;/|G/tj)a}|d{n {Bi 0) 
h;);/O;A;/E;}U}r}L}e} RI u | Bo) 
gi/R;ijeiN{iij|rjmi/ ts r | 
S/T/E|}C;}p/;/A|;F{cja|€E | 9) 
yis|/K;/A/O;C/O}h}] tt} P | (0) 
e|/Ale|s;|M;Fi nj u}Ry t | (7) 
AlY|H;I|N}|S}]i}g}myi {| Lb | 9 
bi i|L}]O; it }o};E}] piri x | (0) 
Nivic}|D]e;d]J{z {Oj n | (00) 


4S Time remaining on timer at completion (SECONDS): 


Start the timer when 
the child reads the 
first letter. Stop the 
timer when the child 
reads the last letter. 


> If the child 
hesitates for 3 
seconds, read that 
letter and then point 
to the next letter and 
say “Continue”. 
Mark the letter you 
read as incorrect. 


W When the timer 
reaches 0, say 
“stop.” 


W If the child does 
not provide a single 
correct response on 
the first line, say 
“Thank you!”, 
discontinue this 
subtask, check the 
box at the bottom, 
and go onto the 
next subtask. 


O 


4S Exercise discontinued because the child had no correct answers in the first line. 


NA1: | NE1: 


Thank you, let’s move to the next task. 


hyA 


Effective Intervention 


SCORE | EGRA The Gambia, May-June 2018 


TAI 5 


Subtask 2: Letter Sound Discrimination 


© x 


& In this exercise, you will listen to the English words that | read. | will read three 
words and one of them starts with a different sound. | will read twice. Tell me which 
one starts with a different sound. 


For example: 


yt 


“cat”, “car”, “hot”; “cat”, “car”, “hot” which one starts with a different sound? 


v¥ & [If the child answered ”hot”, say] Very good, “hot” starts with a different 
sound. 

x a [If the child did not answer “hot”, say] “cat”, “car”, “hot”. “hot” starts with a 
different sound than “cat” and “car”. 


Now let’s try again: 

“light”, “count”, “learn”; “light”, “count”, “learn”, which one starts with a 
different sound? 

va [If the child answered “count”, say] Very good, “count” starts with a 
different sound. 


y» lt 


[If the child did not answer “count”, say] “light”, “count”, “learn”. 
starts with a different sound than “light” and “learn”. 


e 
x a count” 


Did you understand? [wait until the child responds] Are you ready? [wait until the 
child responds] Let’s start. 


ws (VW) 1 = Correct 
(%) 0 = Incorrect 
(“) . =No answer 


eaiese which one starts with a ar ech nome lecarracc leancorecl No 
different sound? response 
1. | book | dog | boy [dog ] 1 0 
2. | like eat egg [like] if 0 
a do get go [do] a 0 
4. | say pay | sad [pay] il 0 
5. |apple[candle| ant | [candle] | 1 | 0 |. 
6. | sun red run [sun] 1 0 
7. | bag ball | kick | [kick] 1 0 
8. is if of [of] it 0 
9. | from | drum | drive| [from] i 0 
10.| fly | good | food | [good] i! 0 


W If the child does 
not provide a 
correct answer in 
the first 5 items, 
say “Thank you!”, 
discontinue this 
subtask, check the 
box at the bottom, 
and go onto the 
next subtask. 


> If the child 
hesitates for 5 
seconds, provide 
the answer. Mark 
the item that you 
provided answer as 
“no response”. 


4 Exercise discontinued because the child had no correct answers in the first 5 items. 


O 


NA2: 


NE2: 


Thank you, let’s move to the next task. 


hyA 


Effective Intervention 


SCORE | EGRA The Gambia, May-June 2018 


Subtask 3. Nonword Reading 


(I Page 2 


60 seconds 


Do not spell the words, but read them. 
For example [Point to the word “ut”], this made up word is “ut”. 


Let’s practice. [Point to the word “dif”] Read this word. 


va [If the child answered dif”, say] Very good, this made up word is “dif”. 
x a [If the child did not answer ’ dif”, say] This made up word is “dif”. 


[Point to the word “mab”] Now let’s try another one. Read this word. 


v a [If the child answered ”mab”, say] Very good, this made up word is “mab”. 
x a [If the child did not answer ”mab”, say] This made up word is “mab”. 


When I say “start”, start here [point to the first word], and read through the page 
[sweep finger across first line]. | will use this timer and will tell you when to stop. 
Point to each word and read out loud. Read as fast and the best you can. If 
there is one word you can’t read, move to the next one. Put your finger on the 
first word [make sure the child does so]. Are you ready? [wait until the child 
responds and prepare to time] Start. 


& In this sheet there are some made-up words. Read as many words as you can. 


45 (/) Mark any incorrect words with a slash ( / ). 
(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(J) Mark the final word read with a bracket (J). 


Examples: — ut dif mab 

1 2 3 4 5 
ri loz yat zam tob | (5) 
zom hon mon jaf git — | (10) 
bas af ked ig el (15) 
tig om dop pif ip (20) 
fe ral mip kag vif | (25) 
lut sig Zop zir naf | (30) 
riz yot wab lat jep | (5) 
wub dod ik vit nux | (40) 
pek ze| bef wab hix — | (45) 
wot ib mig zek vok | (50) 


48 Time remaining on timer at completion (SECONDS): 


Start the timer 
when the child 
reads the first 
word. Stop the 
timer when the 
child reads the last 
word. 


> If the child 
hesitates for 3 
seconds, say the 
word and then 
point to the next 
word and say 
“Continue”. Mark 
the word that you 
provided as 
incorrect. 


W When the timer 
reaches 0, say 
“stop.” 


W If the child does 
not provide a single 
correct response in 
the first line (5 
words), say “Thank 
you!”, discontinue 
this subtask, check 
the box at the 
bottom, and go on 
to the next subtask. 


O 


4S Exercise discontinued because the child had no correct answers in the first line. 


NA3: NE3: 


Thank you, let’s move to the next task. 


Effective Intervention 


hyA 


SCORE | EGRA The Gambia, May-June 2018 


Subtask 4. Familiar Word Reading (C2) Page 3 


60 seconds 


& in this sheet, there are some English words. Read as many words as you can. 
Do not spell the words, but read them. 


For example, [Point to the word “cat”] this word is “cat”. 


Let’s practice. [Point to the word “mat”]. Read this word. 
va [If the child answered ”mat”, say] Very good, the word is “mat”. 
x a [If the child did not answer ”mat”, say] This word is “mat”. 


Now let’s try another one. [Point to the word “top”] 
va [If the child answered ”top”, say] Very good, the word is “top”. 
xm [If the child did not answer ”’top”, say] This word is “top”. 


When I say “start”, start here [point to the first word], and read through the page 
[sweep finger across first line]. | will use this timer and will tell you when to stop. 
Point to each word and read out loud. Read as fast and the best you can. If 
there is one word you can’t read, move to the next one. Put your finger on the 
first word [make sure the child does so]. Are you ready? [wait until the child 
responds and prepare to time] Start. 


4 (/) Mark any incorrect words with a slash (/). 
(@) Mark with a circle the self-corrections if you already marked as incorrect. 


(4) Mark the final word read with a bracket (4). 


Example: cat mat top 
1 2 3 4 5 
but time in the also (5) 
make no its said where | (10) 
came very do after long | (45) 
water run all for paper | (20) 
her was three been more | (25) 
that must can ear it (30) 
jump | words | back | called | work | (35) 
could an him on see (40) 
that get not zip what | (45) 
you if their | teacher; when | (50) 


4 Time remaining on timer at completion (SECONDS): 


Start the timer 
when the child 
reads the first 
word. Stop the 
timer when the 
child reads the last 
word. 


> If the child 
hesitates for 3 
seconds, provide 
the word and then 
point to the next 
word and say 
“Continue”. Mark 
the word that you 
provided as 
incorrect. 


W When the timer 
reaches 0, say 
“stop.” 


W f the child does 
not provide a single 
correct response on 
the first line (5 
words), say “Thank 
you!”, discontinue 
this subtask, check 
the box at the 
bottom, and go on 
to the next subtask. 


O 


4S Exercise discontinued because the child had no correct answers in the first line. 


NAA: NE4: 


Thank you, let’s move to the next task. 


hyA 


Effective Intervention 


SCORE | EGRA The Gambia, May 2018 


Subtask 5a: Passage Reading 


60 seconds 


Subtask 5b: Reading Comprehension 


(I Page 5. 


Show to the children the page of the stimulus booklet while you read the 
instructions. 

@ Here is a short story. | would like that you read this story aloud, 
quickly but carefully. | will use this timer and will tell you when to 
begin and when to stop. If there is a word that you cannot read, go 
to the next one. When you finish, | will ask you some questions 
about the story. Ready? [wait until the child responds and prepare to 
time] You can start. 


4 (/) Mark any incorrect words with a slash ( / ). 
(@) Mark with a circle the self-corrections . 


(4) Mark the final word read with a bracket (4). 


Ali told his friend Ida to go to uncle Musa’s farm, 11 


Ali was hungry and wanted to steal bananas in the 
farm. 


22 


Ida was angry and said: “We cannot dothat, to 
steal is very wrong. 


36 


Let’s just ask.” They found uncle Musa and asked 


ian 53 
him nicely. He gave them one banana each. 


They were glad that they did the right thing. 
62 


4S Time remaining on timer at completion (SECONDS): 


Start the timer when 
the child reads the first 
word. 


> If the child hesitates 
or stops more than 3 
seconds on a word, 
move to the next word 
and say “Continue”. 


% When the timer 


When the child finishes reading, REMOVE the passage from the child’s view and 


ask the first question. 


Ask the child only the questions related to the text read. The child should have 


read the part of the text that corresponds to the question. If a child does not 


give an answer after 10 seconds, mark “no response” and move to the next 


question. Do not repeat the questions. Consider all sensible answers the child 


provides as correct. 


= Nowlam going to ask you about the story you just read. Answer the 


questions the best you can. 


reaches 0, say “stop.” 


W If the child does not 
read any word 


correctly before the 
boxed word | farm 


mark below and move 
to the next task. 


If the child says “I don’t 


know”, mark incorrect. 


Ask the last question 


even if the child only 
reads up to word 53. 


@| S| 2 Z 
° wn 
Questions [Answers] a) Si © 
8) 3] 3 
2) o 
1. Who went with Ali to the farm? [ida] ae 
2. What did Ali want to do in uncle Musa’s 
farm? [To steal bananas] so ies 
3. Why was Ida angry? [Because to steal is very bad; 
because Ali wanted to steal] 1 | 0 
4. How did Ali and Ida get the bananas? [They 
asked nicely, they asked uncle Musa, uncle Musa gave to them] | 1 | 0 
5. How would uncle Musa feel if he found 
1/0 


out what Ali wanted to do? [sad; angry; disappoint] 


2S Exercise discontinued because the child did not read any word correct before the boxed word. [_] 


NA 5a: NE 5a: 


NA 5b: 


NE 5b: 


English Pulaar Mandinka Wolof 


4S Which languages did the child use in this task? (circle all answers that apply) 
Others (please specify) 


SCORE / EGRA The Gambia 


RyA 


Effective Intervention 


Thank you, let’s move to the next task. 


SCORE | EGRA The Gambia, May-June 2018 


Demba was very sad when he lost one of his goats. He could not go to look for the goat, because he had to 
watch the other goats. Demba’s grandfather helped and found the goat. Demba was very happy. 


Subtask 6. Listening comprehension (LE, x 

| am going to read you a short story aloud ONCE and then ask you some questions. Please listen carefully and answer the questions as_| Remove the 

best as you can. You can answer the questions in whichever language you prefer. Ready? [wait until the child responds] ir onl the 
cniia's view. 


Do not allow the 
child to look at 


t . . 
= Now |am going to ask you some questions related to the story: Garrect|‘incorrcet No the passage or 
response | the questions. 
? 
Why was Demba sad? 1 0 ia child says 
[He lost his goat; he could not go to look for it; he cannot see his goat] don’t know”, 
Who helped to look for the goat? : ‘ mark as incorrect. 
[Demba’s grandfather, his grandfather, grandfather] 
Why was Demba happy? , ‘ 
[Grandfather returned with his goat; his goat is back; Grandfather found the goat, he sees/saw the goat etc] 
4S Which languages did the child use in this task? (circle all answers that apply) 
English Pulaar Mandinka Wolof Others (please specify) 
Thank you for doing this exercise with me. [Follow the instruction on the enumeration manual] 
Which language(s) did you use to apply this test? (circle all answers that apply) 
English Pulaar Mandinka Wolof Others (please specify) 


Assessment end time: 


hh: 


No Yes (please specify) 


Does the child have any visible/noticeable disability? (circle as appropriate) 


